-- Logs begin at Mon 2022-09-05 09:59:40 UTC, end at Mon 2022-09-05 11:19:30 UTC. -- Sep 05 10:32:54.896016 dv-cinder-850831-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 05 10:32:54.904976 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 10:32:54 2022] *** Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: nodename: dv-cinder-850831-4-iscsi Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: machine: x86_64 Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: clock source: unix Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: pcre jit disabled Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: detected number of CPU cores: 4 Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: current working directory: / Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: detected binary path: /usr/bin/uwsgi-core Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: your processes number limit is 47680 Sep 05 10:32:54.907476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: your memory page size is 4096 bytes Sep 05 10:32:54.908146 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: detected max file descriptor number: 2048 Sep 05 10:32:54.908146 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: lock engine: pthread robust mutexes Sep 05 10:32:54.908146 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: thunder lock: enabled Sep 05 10:32:54.908146 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 05 10:32:54.908146 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 10:32:54.948030 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: Python main interpreter initialized at 0x55ced57a69c0 Sep 05 10:32:54.948030 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: python threads support enabled Sep 05 10:32:54.948030 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: your server socket listen backlog is limited to 100 connections Sep 05 10:32:54.948030 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: your mercy for graceful operations on workers is 90 seconds Sep 05 10:32:54.948398 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 10:32:54.948476 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: *** Operational MODE: preforking *** Sep 05 10:32:54.948752 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: *** uWSGI is running in multiple interpreter mode *** Sep 05 10:32:54.948752 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: spawned uWSGI master process (pid: 93518) Sep 05 10:32:54.948957 dv-cinder-850831-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 05 10:32:54.949687 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: spawned uWSGI worker 1 (pid: 93530, cores: 1) Sep 05 10:32:54.949869 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: spawned uWSGI worker 2 (pid: 93531, cores: 1) Sep 05 10:32:54.951286 dv-cinder-850831-4-iscsi devstack@keystone.service[93518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 10:32:59.263716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:32:59.263716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: from cryptography.utils import int_from_bytes Sep 05 10:32:59.264477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:32:59.264477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: from cryptography.utils import int_from_bytes Sep 05 10:32:59.270219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:32:59.270219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: from cryptography.utils import int_from_bytes Sep 05 10:32:59.270688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:32:59.270688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: from cryptography.utils import int_from_bytes Sep 05 10:32:59.314849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 10:32:59.315036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 10:32:59.315228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] command line args: [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 10:32:59.315496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 10:32:59.315673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ================================================================================ {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 10:32:59.315927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] admin_token = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.316173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] config_dir = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.316359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.316540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] config_source = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.316741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] debug = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.316938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.317426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.317517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.317718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.317965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 10:32:59.318380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_config_append = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 10:32:59.318526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] command line args: [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 10:32:59.318725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_dir = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_file = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.318973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 10:32:59.319075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ================================================================================ {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 10:32:59.319200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] admin_token = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] config_dir = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.319922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] config_source = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] debug = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.320916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_config_append = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_dir = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.321960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_file = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] publish_errors = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.322998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.323964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] standard_threads = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.324938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] use_journal = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] use_json = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] use_stderr = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] use_syslog = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.325934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.326284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.326383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] publish_errors = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.326461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.326616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.326706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.326849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.326929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.327027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.327177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.327274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.327428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.327508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.327648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.327731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] standard_threads = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.327882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.327965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.328790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.328886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.329033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.329111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.329224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] use_journal = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.329345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.329436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] use_json = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.329510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.329586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] use_stderr = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.329734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] use_syslog = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.329816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.329966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:32:59.330211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.330940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.331983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.332984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.333917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.334855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.335973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.336911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.337911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.338999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.339930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.340969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.341904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.342999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.343974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.344915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345016 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.345934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.346879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.347997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.348968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.349921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.350975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.351999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.external = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.352956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.password = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] auth.token = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.353969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.354927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.external = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.355866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.password = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] auth.token = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.356859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.357977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.358944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.359957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.360941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.361991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.362968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.363907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.364868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.365980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.366937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.367942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.368912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.369876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.370958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.371983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.372988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.373950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.374894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.375567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.375733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.375820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.375894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.376859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.377952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.378985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.379930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.380888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.381977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.382996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.383930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.384936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.385903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] role.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] role.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.386991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.387968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.388944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] role.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.389838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] role.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.390624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.391998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.392963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.393950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.394942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.395683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.396903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.397929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.398940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.399974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.connection = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.400892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.401921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.402952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.403962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.connection = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.404872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.405543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.405543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.405543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.405895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.405895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.406144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.406309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.406744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.407043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.407292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:32:59.407468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 10:32:59.432407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.432660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.432893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.435717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.435948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.436173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.441942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.445274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.470989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.471209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.472132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.472369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.525416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.525754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.574487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.574716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.574879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.575020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.745305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.745574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.745739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.745897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.746963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.778729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.778925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.779886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.780011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.780137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.780262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.780396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.780396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.791837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.792248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.808847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.809952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.810026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.810099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.810186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.810263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:32:59.827002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.827135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:32:59.827460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.827661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:32:59.827819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.827959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.828798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:32:59.828948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.829087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.829323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.829323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.829580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:32:59.829580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.829834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.830053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.830315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.838833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.839112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.839379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.839656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.840125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.840406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.840702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.840989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.847184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.848624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.850090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.850376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.850692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.850973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.851258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.851519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.851693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.851828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.852975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.853118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.853354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.853629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.853903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.854179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.854448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.876462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.877942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.878237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.878724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.880202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.880490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.882889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.883169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.883451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.885205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.885494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.885779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.889785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.890066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.892365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.892672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.895747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.896045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.896334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.896640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.896922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.897199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.897473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.897744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.898383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.898687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.898985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.899279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.899561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.899844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.900123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.900400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.913338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.919341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.919463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.919463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.919629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.920301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.920708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.921004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.924199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.924493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.925764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.928730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.928893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.931946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.932181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.932488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.932802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.933082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.933357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.933645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.935301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.935606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.935899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.936189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.936467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.936774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.949927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.950223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.950502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.953873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.954454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.954454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.954581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.954754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.958213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.959750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.961284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.961570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.961705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.963264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.964284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.964570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.964806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.964917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.965085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.965200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.965598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.967732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.968021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.968342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.968676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.969120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.976899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.977184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.977465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.977747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.978124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.978412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.978691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.980501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.980917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.981222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.981373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.981756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.982064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.982331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:32:59.994498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.997413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:32:59.998432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.000861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.002285 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.002378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.003781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.004044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.004434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.005392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.006848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.008340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.008650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.009058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.010762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.012212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.015121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.015483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.015643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.016187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.016187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.017022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.019924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.020324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.020631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.020914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.023897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.024195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.024482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.028781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.029036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.029331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.031418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.031697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.031977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.032252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.032525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.032822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.033104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.033368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.033642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.033924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.034206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.034459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.034728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.034985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.036381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:33:00.036697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.036980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.037264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.037537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.037809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.038093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.038372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.038645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.038932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.039217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.039485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.039837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.040101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:33:00.070075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ced57a69c0 pid: 93531 (default app) Sep 05 10:33:00.073356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b4222-9434-4418-b79c-e837d342836e None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:00.074106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b4222-9434-4418-b79c-e837d342836e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:00.074106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b4222-9434-4418-b79c-e837d342836e None None] PATH_INFO: `/v3` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:00.076196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ced57a69c0 pid: 93530 (default app) Sep 05 10:33:00.078376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Sep 5 10:33:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:07.794061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:07.794636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:07.794636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:07.798886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:07.804063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:07.804628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:07.804628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:07.876496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: INFO dbcounter [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] Registered counter for database keystone Sep 05 10:33:07.897685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG oslo_db.sqlalchemy.engines [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 10:33:07.903874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writer thread running {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 10:33:08.086708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG passlib.handlers.bcrypt [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93531) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 10:33:08.087027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG passlib.handlers.bcrypt [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93531) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 10:33:08.145003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:08.146615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:08.275861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 10:33:08.771788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:08.842102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: INFO dbcounter [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] Registered counter for database keystone Sep 05 10:33:08.862582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 10:33:08.868842 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writer thread running {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 10:33:08.987133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9cf3-a5ef-4446-ba8c-8d53b70901aa None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:08.991795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:08.992449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:08.992787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:08.993093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:09.002112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:09.053676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 10:33:09.053960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec89b6-7689-4b7d-b54e-25173ae38cf6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:09.063187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 5 10:33:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:33:09.069145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:09.083834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5792c-6758-49fb-b3db-d4739428af6e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:09.088506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:09.089669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:09.089959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:09.090229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] PATH_INFO: `/v3/projects/5e124170ce0a463092ee8c909184559a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:09.091843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e124170ce0a463092ee8c909184559a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:09.144881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 10:33:09.145223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daf222-acc1-42ee-925e-6963dff21673 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:09.149957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Sep 5 10:33:09 2022] GET /identity/v3/projects/5e124170ce0a463092ee8c909184559a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:11.013893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e959-6289-4aa0-b619-f451c0c8889c None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:11.014384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e959-6289-4aa0-b619-f451c0c8889c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:11.014487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5e959-6289-4aa0-b619-f451c0c8889c None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:11.019342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:11.024664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:11.025038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:11.025207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:11.045375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:11.046878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:11.054945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 10:33:11.320926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e959-6289-4aa0-b619-f451c0c8889c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:11.333868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5e959-6289-4aa0-b619-f451c0c8889c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:11.338085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:11.338685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:11.338967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:11.339241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:11.347024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:11.348811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c267c6c-c881-4e71-beb4-5123bcb68da1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:11.357467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 5 10:33:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:33:11.362958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:11.371936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98b467-6aa3-4191-852b-92d39b75f3d6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:11.377118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:11.377748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:11.378024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:11.378293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:11.379579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:11.381450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6b8f2-c31e-47bb-b2bd-d87bc9e575e6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:11.382955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Sep 5 10:33:11 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:13.343030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0c4a-ba37-4897-9fdd-0486915bb92a None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.343530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0c4a-ba37-4897-9fdd-0486915bb92a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.343530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0c4a-ba37-4897-9fdd-0486915bb92a None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:13.345671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:13.350704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.351093 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.351255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:13.369741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:13.370914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:13.385798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ecc7-d59b-432e-8aa5-312f4da4f64b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.386161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ecc7-d59b-432e-8aa5-312f4da4f64b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.386505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1ecc7-d59b-432e-8aa5-312f4da4f64b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:13.387925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:13.392967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.393254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.393532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:13.435487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG passlib.handlers.bcrypt [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93530) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 10:33:13.435882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG passlib.handlers.bcrypt [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93530) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 10:33:13.450894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:13.486028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:13.487624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:13.586073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:13.719632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:13.745633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:13.823331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74169cb4-cd73-432e-9665-c8d7ca22d34b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:13.855304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:13.856710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:13.857370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.857651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.857925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:13.873555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:13.882602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:13.883544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:13.884401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:13.889369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:13.960152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097218d0-a3c8-4c16-bbf5-fcff8e20a44e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:13.962473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:13.972327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:13.990119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9683a72-cca9-4766-97e6-42eb32d0148d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:13.997052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:13.997928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:13.998211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:13.998485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.024673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.025284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.025562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.025833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.026591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:14.026893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.028304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.040416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:14.045882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:14.069885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.071443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.143878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de4fcc-7dbb-4a10-a307-9d63104d48bd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:14.167825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:33:14.173885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:14.177173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:14.177284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.177500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.177777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.178044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.179179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.180662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.182232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:14 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:14.187612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:14.204264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:14.271372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeb526-d70d-4d2e-8d0f-6f133b01c9d3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:14.287700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed52249-0930-49d8-ba99-86ae87ea987d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:14.307697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.308550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.308855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.309125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.321479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.322106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.322383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.322655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.323763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.325260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.327041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:14.327473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.329210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.332932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:33:14.348612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:14.349840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:33:14.350748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:33:14.350748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:33:14.350748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:14.350748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:14.355276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:14.410848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:14.413987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:14.432315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df828e77-eebc-4e14-ad7f-7ab137c89627 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:14.454565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fb2c3-028f-48b7-a31c-4283a12224c4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:14.465266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.465870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.466145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.466415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.467130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.domain.id=default, user.id=bcff4f18a9994f58badcd6e80f8b0bfa) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:14.467472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.468952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad903-4397-43a2-bf75-39368c0aed23 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.476331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 5 10:33:14 2022] GET /identity/v3/role_assignments?user.id=bcff4f18a9994f58badcd6e80f8b0bfa&scope.domain.id=default&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:14.489594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:14.490227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:14.490503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:14.490770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:14.491453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:14.491753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:14.493223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a741163-9e18-4b1e-915e-e2a241426c29 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:14.512904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:16.806850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289659-5346-4109-ae54-3d15a0a792a0 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:16.807890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289659-5346-4109-ae54-3d15a0a792a0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:16.808388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13289659-5346-4109-ae54-3d15a0a792a0 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:16.810232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:16.815189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc914-c4fa-43ea-a97f-e94cb539f6cf None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:16.816037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc914-c4fa-43ea-a97f-e94cb539f6cf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:16.816223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615f242-6a5b-47eb-9ae2-1d199cb34999 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:16.816465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615f242-6a5b-47eb-9ae2-1d199cb34999 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:16.816772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615f242-6a5b-47eb-9ae2-1d199cb34999 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:16.817093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc914-c4fa-43ea-a97f-e94cb539f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:16.818072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:16.828670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2970-e4ec-4501-a3cd-9216e141a838 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:16.829235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2970-e4ec-4501-a3cd-9216e141a838 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:16.829685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2970-e4ec-4501-a3cd-9216e141a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:16.846305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e16fc914-c4fa-43ea-a97f-e94cb539f6cf None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:16.847804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e16fc914-c4fa-43ea-a97f-e94cb539f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:16.857581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-872d2970-e4ec-4501-a3cd-9216e141a838 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:16.859734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-872d2970-e4ec-4501-a3cd-9216e141a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:16.998993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:17.019685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:17.074964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491065-6b11-4131-92c8-3c0b63e3e51b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.075169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491065-6b11-4131-92c8-3c0b63e3e51b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.075687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491065-6b11-4131-92c8-3c0b63e3e51b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.077821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 12/26] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:17.083332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.083615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.083887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.114688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:17.115873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:17.131820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead5c0-5b93-4be9-b56c-c9062ec5631c None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.132411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead5c0-5b93-4be9-b56c-c9062ec5631c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.132956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead5c0-5b93-4be9-b56c-c9062ec5631c None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.134934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:17.140322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.141491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.142248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.181998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:17.184379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:17.266705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:17.289140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:17.326752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:17.387332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:17.392102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:17.475073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:17.494946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176106c6-adf3-48fe-b165-042702f595d7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:17.544071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:17.544870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.545156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.545429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.560770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:17.566627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:17.567511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:17.568295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:17.574033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:17.677142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:17.713250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75d67-88de-4e63-b3c8-4823c12ad81d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:17.727508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b09d32-034a-438e-a44c-42e755fa83e2 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:17.751234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:17.752098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.752519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.753042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.753977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:17.754419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:17.755960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:17.769774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:17.771128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:17.773269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:17.774255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.774730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.775251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.787062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:17.789190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:33:17.806325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:17.807251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:33:17.808073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:33:17.808073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:33:17.808073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:17.810079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 15/32] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:17.816443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:17.848743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:17.881472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ace4ae-a844-4efd-a4ff-57ae6d26d776 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:17.910219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:17.919085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:17.919708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.919987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.920261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.920960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:17.923138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:17.936053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb1e7-aaa3-4ddd-80ef-1d97523eea48 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:17.974816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:17.975438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:17.975717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:17.975992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:17.976702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:17.978125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.127792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 18/33] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 5 10:33:17 2022] POST /identity/v3/roles => generated 225 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:18.135264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:18.176850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 16/34] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 5 10:33:17 2022] POST /identity/v3/roles => generated 219 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:18.177931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:18.317249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5942aa-3a08-40a7-a770-bb2c9985df56 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:18.363400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:18.364613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.365109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.365856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.368067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:18.370046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056365-dea7-46e6-8438-4f1a13b5b47a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.372759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 19/35] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:18 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:18.375566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270e35-37f4-40ba-9c8a-6c3dee96b16b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.376139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270e35-37f4-40ba-9c8a-6c3dee96b16b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.376637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270e35-37f4-40ba-9c8a-6c3dee96b16b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.378391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 20/36] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:18.379600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f270e35-37f4-40ba-9c8a-6c3dee96b16b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:18.425464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:18.435956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b3c4f-4e75-437b-92ad-81a95b0ff90f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:18.466558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:18.494991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:18.495631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.495912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.496194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.496938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:18.497247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:18.499218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69645a5-3f9f-4661-aaeb-2a4f5c25ae4f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.515584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 17/37] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:18.518766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3fd2-58aa-407b-996c-bc17e31bda2e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.519059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3fd2-58aa-407b-996c-bc17e31bda2e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.519341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3fd2-58aa-407b-996c-bc17e31bda2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.529020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f270e35-37f4-40ba-9c8a-6c3dee96b16b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:18.639776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f56c3fd2-58aa-407b-996c-bc17e31bda2e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:18.639776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f56c3fd2-58aa-407b-996c-bc17e31bda2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:18.640027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:18.640027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.640027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.640027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.640352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:18.640352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.640352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 21/38] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:18.640352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 18/39] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045b6f-dcc1-41a5-b966-34c82b378d93 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045b6f-dcc1-41a5-b966-34c82b378d93 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49045b6f-dcc1-41a5-b966-34c82b378d93 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 19/40] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:18.640686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045b6f-dcc1-41a5-b966-34c82b378d93 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:18.725181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:18.749874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49045b6f-dcc1-41a5-b966-34c82b378d93 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:18.789031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:18.789702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.789985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.790261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] PATH_INFO: `/v3/domains/default/users/bcff4f18a9994f58badcd6e80f8b0bfa/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.792615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bcff4f18a9994f58badcd6e80f8b0bfa, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:18.794093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5fd3b-7f11-46ee-953d-74a119cebbd9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.805948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db700-a562-4b1c-8386-0cf4fe72087d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:18.830835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:18.845798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:18.846686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.847417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.847834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.849025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:18.850947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:18.944425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Sep 5 10:33:18 2022] PUT /identity/v3/domains/default/users/bcff4f18a9994f58badcd6e80f8b0bfa/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:18.945687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:18.945972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:18.946245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:18.973966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:18.975206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:18.979224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:33:18 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:18.980097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:19.094036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:19.127908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154dd89-3730-438d-9499-d93a6705c054 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:19.166425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:19.167048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:19.167380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:19.167664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:19.168343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:19.169803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:19.276168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 5 10:33:18 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:19.369948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:19.442017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:19.477430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43344d9-3868-4bd3-8fe0-eb5380cea5e4 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:19.512040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:19.512706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:19.512990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:19.513270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:19.514398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:19.516488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664286-6b32-42c5-a506-8ff3d257720d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:19.518318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:19.523618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:19.558571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:19.623145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad539e65-d1a0-4534-a10f-3028a413fb07 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:19.657770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:19.658390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:19.658673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:19.658950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:19.659620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:19.661139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ab0a6-7eb5-4112-8959-835dfe3ee84b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:19.748288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:33:19 2022] POST /identity/v3/projects => generated 312 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:20.928295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8890c-f6ea-4c09-a8c7-0e54191c3c76 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:20.928859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8890c-f6ea-4c09-a8c7-0e54191c3c76 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:20.928859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8890c-f6ea-4c09-a8c7-0e54191c3c76 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.930200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:20.935191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:20.935602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:20.935747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.955966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:20.957555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:21.024571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:21.290100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8890c-f6ea-4c09-a8c7-0e54191c3c76 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:21.388618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8890c-f6ea-4c09-a8c7-0e54191c3c76 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:21.421382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:21.422543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.422819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.423084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.426738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:21.434629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:21.442418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:21.443500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:21.444336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:21.449512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:21.467449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:21.552026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f671b8-f045-4c03-af57-65240511d32a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:21.586193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:21.586799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.587074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.587341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.588005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:21.588303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:21.589900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71aae1-205b-43ad-bb1f-59903ec27133 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:21.598260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 26/50] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:21.603762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:21.666884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2847-a603-4499-b081-93dce0117285 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.667183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2847-a603-4499-b081-93dce0117285 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.667452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2847-a603-4499-b081-93dce0117285 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.668836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 27/51] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:21.674305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.674587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.674866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.693021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:21.694237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:21.707954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98c7b-c0be-4ac1-85b7-a40ff3d796bc None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:21.743972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:21.744670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.744956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.745236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.746389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:21.747863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:21.749511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 25/52] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:21 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:21.756210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:21.759683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:21.818518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:21.857366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9fc4-617b-4922-83d1-7565e49e1675 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:21.891794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:21.892432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:21.892754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:21.893034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:21.894172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:21.895655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:21.897270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 26/54] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:21.903177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:21.914184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:22.002106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6d6db-c8af-483f-bf52-0d87c783bd5c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:22.028337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:22.035555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:22.036165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:22.036444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:22.036749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:22.037475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.domain.id=default, user.id=bcff4f18a9994f58badcd6e80f8b0bfa) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:22.037779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:22.039236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:22.045035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 29/55] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 5 10:33:21 2022] GET /identity/v3/role_assignments?user.id=bcff4f18a9994f58badcd6e80f8b0bfa&scope.domain.id=default&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:22.137761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2585e-93aa-41c2-8f61-34102b7a6928 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:22.168238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:22.173854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:22.174512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:22.174800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:22.175081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:22.176242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:22.177750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a30f6-4473-44a5-9be3-e9ef3e42b4a7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:22.179350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:22.185173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:22.257657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:22.286633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa7b21-a72f-47bd-b612-92615f0e628a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:22.319784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:22.320394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:22.320704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:22.320982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:22.321643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:22.323104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc7c72-614f-43da-85eb-16fde2b58fee None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:22.406854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 30/57] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 5 10:33:22 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:33:24.292441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd9ec-06b3-4f48-8c4c-64d3c5781aae None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:24.292974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd9ec-06b3-4f48-8c4c-64d3c5781aae None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:24.292974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd9ec-06b3-4f48-8c4c-64d3c5781aae None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:24.294283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:24.300049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:24.300435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:24.300631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:24.318738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:24.319949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:24.384594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:24.671534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd9ec-06b3-4f48-8c4c-64d3c5781aae None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:24.877501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd9ec-06b3-4f48-8c4c-64d3c5781aae None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:24.910633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:24.911261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:24.911548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:24.911826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:24.912972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:24.914472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf1e9c-fe57-4a0d-ba1e-7e4ca3f446e9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:24.916062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:24.922156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:24.976658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:25.021364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e5e7-d3d3-486f-b2d4-01c6fc9bc984 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:25.053216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:25.053823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:25.054112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:25.054387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:25.055047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:25.056506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d51bd5-c600-448c-b570-761fa7c63363 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:25.187052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:24 2022] POST /identity/v3/users => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:28.340514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4a9c-ce3e-4951-b217-d13ddef07e56 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.341513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4a9c-ce3e-4951-b217-d13ddef07e56 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.342024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4a9c-ce3e-4951-b217-d13ddef07e56 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.343602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:28.349246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476c57-c5df-4145-b61d-ec614664227c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.350077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476c57-c5df-4145-b61d-ec614664227c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.350564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98476c57-c5df-4145-b61d-ec614664227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.374603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576681-175b-4f27-9e9d-0d788f67385e None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.376044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576681-175b-4f27-9e9d-0d788f67385e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.376626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576681-175b-4f27-9e9d-0d788f67385e None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.377618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-98476c57-c5df-4145-b61d-ec614664227c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.378577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:28.380976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-98476c57-c5df-4145-b61d-ec614664227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.385192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67546f6-28d9-4ced-b3bb-6691f64b983a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.385705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67546f6-28d9-4ced-b3bb-6691f64b983a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.386182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67546f6-28d9-4ced-b3bb-6691f64b983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.409081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c67546f6-28d9-4ced-b3bb-6691f64b983a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.410620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c67546f6-28d9-4ced-b3bb-6691f64b983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.485841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:28.492305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:28.507984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:28.508500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbd80-1305-40d9-a4c5-41791f729a50 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.508827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbd80-1305-40d9-a4c5-41791f729a50 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.509168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbd80-1305-40d9-a4c5-41791f729a50 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.510525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:28.516974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01bb5c-76cf-4fe9-9048-42cbd860b591 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.517269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01bb5c-76cf-4fe9-9048-42cbd860b591 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.517546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01bb5c-76cf-4fe9-9048-42cbd860b591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.537395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9b01bb5c-76cf-4fe9-9048-42cbd860b591 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.538590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9b01bb5c-76cf-4fe9-9048-42cbd860b591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.592015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:28.637637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:28.666628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006217-7a48-4772-8047-62b9972ed757 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.666928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006217-7a48-4772-8047-62b9972ed757 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.667189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006217-7a48-4772-8047-62b9972ed757 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.668869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 34/68] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:28.673894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.674192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.674473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.696557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.697762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.781926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99008345-6fee-49de-88de-72b76f1cf21b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.782254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99008345-6fee-49de-88de-72b76f1cf21b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.782479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99008345-6fee-49de-88de-72b76f1cf21b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.784058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 35/69] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:28.785706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 35/70] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:28.788934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.789217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.789493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.833691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.833899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:28.834124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.946808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:28.955077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbd95b-50f8-4746-ad0e-539aa73da3e3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:28.976974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 36/71] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:28.977831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:28.998511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:28.999483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.000632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.001294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.012620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:29.019268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:29.020136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:29.021041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:29.023265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 36/72] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:29.024233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.103397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019c79-67f8-469c-84ac-d25309775d70 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.132901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.138299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26b99-e0bc-426b-b981-3839de33c725 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.145634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.145634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.145634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.145634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.152068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:29.157340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:29.158186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:29.158979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:29.159611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.179983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.180647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.181059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.181337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.192352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:29.197292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:29.198128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:29.198899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:29.199552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.223564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.270906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8093b2-9738-4fa5-89b0-61357fb390c6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.303786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ca62-15f3-45cc-8625-c20bb9705fdb None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.305903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.306520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.306798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.307070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.307732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:29.308032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.309436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.321859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.322658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.341274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.341912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.342193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.342468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.352869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:29.357679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:29.358562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:29.360901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.378054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.428022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e92a-2eff-446c-80c3-0268e0ba31c6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.442512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.460765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1ee3a-ffbf-40e5-8fc0-6d5016e44c55 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.461829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.462439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.462719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.462995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.463659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:29.463963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.465373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.478706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.478706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.496880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.497492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.497772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.498045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.498714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:29.499018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.500679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.508580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.512703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.581032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901acd5-92a0-4e63-b25f-46543baed990 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.595516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.610919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ef595-ba60-4e5a-93e8-96ad05586592 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.617964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.618596 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.618901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.619176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.620386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.621915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.623521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.624377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.648697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.649337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.649623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.649898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.651077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.652548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.654194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.654961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.667958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.733718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644445-2e0b-4c68-9d57-6ef60b4b3b9a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.765202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493692ad-19f9-4d3a-a166-eceb47ecc940 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.768753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.769736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.770265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.770690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.771312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:29.771743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.773719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.783882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.784738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.807106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.807743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.808026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.808292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.821885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.823372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.825063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.825823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.835503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.900417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09281e6-4c72-49d5-8336-36f309cfbcd5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.901486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.935272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6c17-abff-4b80-817e-76d71e748687 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.942801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.943451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.943763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.944043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.945237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.946723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.953660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:29.953660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:29.974004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.974618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.974897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.975167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.975829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.977312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.068331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90ad5f-3a64-40f2-8096-28981ba64828 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.073810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 42/84] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:29 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:30.074656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.087030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.107494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.111608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.111608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.111608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.190901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.192585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.209216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407b937-5feb-4f0b-87b6-2d4f62dbb2ae None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.242073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.258382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.258382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.258382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.258382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.261247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.261585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.263460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 43/85] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:30.264327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.337689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 43/86] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:30.339279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.354683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.401576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53069d1f-faea-4bec-a663-533a84275fee None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.447920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.449056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.449501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.449972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.477673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4b9bf-ff01-466c-b23f-5e168c09996f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.514446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.515070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.515924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.516206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.535965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.545594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.547212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.588609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.590026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.602716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.692718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 44/87] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:30.693746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.701523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 44/88] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:30.702262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.804538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.813680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714f27-beaf-491b-b48a-6ccda92db006 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.828620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadfebf-e907-4fce-8e81-79854864b866 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:30.843191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:30.854214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.854935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.855233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.855492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.857309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.859386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.862073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 45/89] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:30.863244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:30.873978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:30.877321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:30.878117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:30.878864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:30.973636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:30.976053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:30.993571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e5674-c078-47d8-8dad-c43a3cbe6b4f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.033797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.034438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.034719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.034990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] PATH_INFO: `/v3/projects/37329022618f43cb8889d818637da14a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.036203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] RBAC: Authorizing `identity:get_project(project_id=37329022618f43cb8889d818637da14a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.037768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.039681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/projects/37329022618f43cb8889d818637da14a => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.044484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.072768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.117117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:31.119057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.149861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693615cb-ac6c-4f1e-acfc-3f3667768d0b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.152679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.193711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.194899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.195399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.196062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.198145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.199774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.202891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.203990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.241891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75d1c5-e49b-44de-bfa7-53948e8762a2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.282030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.282639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.282984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.283328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.284420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=bcff4f18a9994f58badcd6e80f8b0bfa) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:31.284816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.286837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.300627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/role_assignments?user.id=bcff4f18a9994f58badcd6e80f8b0bfa&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.300627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.368350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb31e2-222e-440e-ba68-c1a8938bd5b5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.376831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.442101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.442741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.442993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.443268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.444060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=37329022618f43cb8889d818637da14a, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:31.444373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.445960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.455339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.465656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=37329022618f43cb8889d818637da14a&role.id=47fd5bc6d0614f6390457e9815727925 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.467652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.526669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeb634-7211-4228-ae32-fb6a2fbdbbed None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.599244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433187-0435-4c67-bd97-69cd2d84a7c1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.637091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.637285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.637624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.637910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.638021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.638173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.638262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.638504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.638911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:31.639327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.641462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.645390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.646886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844e1ce-666a-4116-ad0d-4168af8176f9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.647370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 49/95] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.648947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 47/96] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:31.654755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.709006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.823114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5860-446b-48a3-b5c0-dc383bd90e62 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.872343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.873008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.873289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.873567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.874311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:31.875159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:31.876813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507e7db-70f2-455c-847a-b6ebc99ec117 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:31.889241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 50/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=475895c891594cd884efae065d6f7da7 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:32.311931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771616b-374e-49fb-b9dd-90c510a958a4 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:32.312749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771616b-374e-49fb-b9dd-90c510a958a4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:32.313210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771616b-374e-49fb-b9dd-90c510a958a4 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:32.314957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 48/98] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:32.320507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005732-5440-439d-b5b1-a5171a9439f4 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:32.321063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005732-5440-439d-b5b1-a5171a9439f4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:32.321535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005732-5440-439d-b5b1-a5171a9439f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:32.343727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-64005732-5440-439d-b5b1-a5171a9439f4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:32.344969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-64005732-5440-439d-b5b1-a5171a9439f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:32.440572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:32.800379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fc32f-16f1-4cc7-9586-6181674e7215 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:32.801434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fc32f-16f1-4cc7-9586-6181674e7215 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:32.801916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fc32f-16f1-4cc7-9586-6181674e7215 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:32.803484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 49/100] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:32.810381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:32.810813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:32.810936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:32.837787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:32.839245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:32.858178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:32.931182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 52/101] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:32.981601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fc32f-16f1-4cc7-9586-6181674e7215 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.103059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fc32f-16f1-4cc7-9586-6181674e7215 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.138619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.139251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.139580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.139856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.151343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:33.156465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:33.157366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:33.158162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 50/102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:33.163760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.282386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b8e6b-0b24-43bc-8155-efe11ee4ad4f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.316520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.317436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.317890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.318332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.319194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:33.319665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:33.321242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:33.330678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 53/103] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:33.336625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.339727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:33.411914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.432966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:33.469114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591dd36-d93e-49ed-97ad-2839e21c7c6d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.541948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.542637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.542967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.543246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] PATH_INFO: `/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.580628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] RBAC: Authorizing `identity:get_user(user_id=91f3a068e72c4b288e9bd4d4313b6c8f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:33.580628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:33.581985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 51/104] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:33 2022] GET /identity/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:33.587764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.606988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc1802-4056-4372-9050-57a59e579a1f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.669394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.670076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.670435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.670784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.672899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:33.674448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:33.676655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 54/105] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:33.684170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:33.729982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:33.805587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:33.828435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23076a-e2ff-469c-bb03-c3df0c5328be None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.832479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55671-9778-405a-a04b-4d129ad2de81 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:33.885320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.885947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.886244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.886526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.887208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:33.888705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d40a2-867c-4473-b7d0-9a2bc6610b0e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:33.925749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:33.925749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:33.925749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:33.925749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:33.982442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 55/106] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:33:33 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:34.049406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:34.050916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:34.117805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.118233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f73f3-c267-4684-9ef1-5e6c7b126242 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.118535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f73f3-c267-4684-9ef1-5e6c7b126242 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.118819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f73f3-c267-4684-9ef1-5e6c7b126242 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.120427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 56/107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:34.126796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.127121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.127386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.165951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:34.167249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:34.186053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:34.193490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:34.346153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 57/109] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:34.356418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09f8ff-69ef-48e9-9562-390198cc99f7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:34.401647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:34.402296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.402591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.402855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.409371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:34.410854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:34.412818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 53/110] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:34 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:34.418960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:34.489518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.544609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37feb796-b934-42b5-878f-56726c4f1ffb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:34.590091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:34.590711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.590992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.591263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.592003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=91f3a068e72c4b288e9bd4d4313b6c8f) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:34.592311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:34.593838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36a797-e895-437f-a5c7-7e7ff0ca45f0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:34.599899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 58/111] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:34 2022] GET /identity/v3/role_assignments?user.id=91f3a068e72c4b288e9bd4d4313b6c8f&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:34.661599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:34.679746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44c52-8f74-4e9d-9a9d-b0ff30d77932 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.680076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44c52-8f74-4e9d-9a9d-b0ff30d77932 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.680310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44c52-8f74-4e9d-9a9d-b0ff30d77932 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.681748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 59/112] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:34.687834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d0fb-9b1f-467f-8e27-128e43f8ec34 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.688342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d0fb-9b1f-467f-8e27-128e43f8ec34 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.688776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0d0fb-9b1f-467f-8e27-128e43f8ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.701338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.721593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8eb0d0fb-9b1f-467f-8e27-128e43f8ec34 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:34.722830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8eb0d0fb-9b1f-467f-8e27-128e43f8ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:34.811723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db07fa-6091-4f4b-882a-b3cc62adfdad None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:34.851006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 60/113] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:34.852094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20d2-059f-4236-a2ae-ac4cf70fadb6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.852397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20d2-059f-4236-a2ae-ac4cf70fadb6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.855667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:34.856934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.857450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.857927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.860780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20d2-059f-4236-a2ae-ac4cf70fadb6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.862262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 61/114] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:34.870103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.870378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.870667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.871463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:34.877569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:34.878502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:34.879304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:34.881923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 54/115] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:34.897595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:34.941301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:34.942511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:35.010765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.024682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6c91-1911-4953-905a-ccf6e39e9128 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.064399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.065672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.066150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.066625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.067524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:35.068080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:35.069748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b180a-945f-4129-a72a-63a9631a23d6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:35.072998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.080850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 55/116] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:35.082451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b2e-f50f-4452-8047-0bac71332082 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.083001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b2e-f50f-4452-8047-0bac71332082 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.083479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b2e-f50f-4452-8047-0bac71332082 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.085287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 56/117] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:35.094152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.094309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.094593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.116849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 62/118] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:35.117123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.130970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:35.133183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:35.278717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 57/119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:35.342793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.440314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.446555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4790e1-dc65-4f29-8582-8c8ef1342b56 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.463425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9df7c-935f-42b6-badc-b32e67ffd434 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.532180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.532866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.533146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.533475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.534780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:35.541308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:35.543330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 63/120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:35.550928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.562713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.562713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.562713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.562713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.587753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:35.593199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:35.594263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:35.595156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:35.602684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 58/121] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:35.603765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.625602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.679614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf6359-767b-45e2-875e-e1cd7d94feef None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.719218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.720099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.720533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.721126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.722734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:35.724330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:35.726576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 64/122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:35.727567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.823169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f178b8-4320-4dce-b8f8-613610464e9c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.853237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8cc3f-18fe-4fc5-8bd1-9d1342ae28ee None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:35.858446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.859737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.860116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.860487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.870890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:35.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:35.877621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:35.878530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:35.879901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:35.884754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:35.884933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.887145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:35.907253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:35.908040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:35.908422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:35.908844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:35.909656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:35.910074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:35.911764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:35.926964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 65/124] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:35.928007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.001137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae301a-0619-4a23-88ed-45a922c17a84 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.036818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.037789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.038272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.038753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/bcff4f18a9994f58badcd6e80f8b0bfa/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.041118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, user_id=bcff4f18a9994f58badcd6e80f8b0bfa, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.043420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.058541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258cab-f133-48b8-8b1d-2b3949eec959 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.094585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.095213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.095493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.095763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.106087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:36.120492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:35 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/bcff4f18a9994f58badcd6e80f8b0bfa/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:36.120492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:36.120774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:36.121593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 66/126] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:36.122365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.216888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:36.243216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:36.328630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515734f9-cac1-41bb-89ec-57f12f812512 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.341716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4eb36-4256-4972-ae0f-d8b75ef471a2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.380236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.381410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.382029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.382588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.382929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.383571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.383847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.384119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.384366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:36.384984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.385251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.386714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.387036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.392620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 67/127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.392620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.402695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 61/128] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.403370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.523575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121e1f-1b56-4c58-9e62-6e36dfaeb43e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.537770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:36.566425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.567520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.568021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.569116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.570272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:36.570786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.572381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.584922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 68/129] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.590090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.599257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8f73c-b4fe-4309-a580-41ed2c0b243f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.646794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:36.674900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.675554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.675835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.676152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] PATH_INFO: `/v3/projects/37329022618f43cb8889d818637da14a` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.680240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] RBAC: Authorizing `identity:get_project(project_id=37329022618f43cb8889d818637da14a)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.682240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.688074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 62/130] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/projects/37329022618f43cb8889d818637da14a => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.688074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.716710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de51a29-74be-4786-82c7-6ff481eed95b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.758520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.759557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.760298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.760799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.763042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.764753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.766586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 69/131] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.767592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.821746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:36.851668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2242b-77b8-4cc0-b8af-fc4b369693bb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.898392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe73c1-5093-4881-b26a-fae11edb1264 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:36.915200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.916555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.917100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.917576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.919557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.923476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:36.926590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 63/132] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:36.928000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:36.942423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:36.943466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:36.943940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:36.944400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] PATH_INFO: `/v3/projects/37329022618f43cb8889d818637da14a/users/4dd7566ac1204db28ef70c6510a539b4/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:36.947205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=37329022618f43cb8889d818637da14a, user_id=4dd7566ac1204db28ef70c6510a539b4, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:36.949404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5f123-ffc4-4e6d-86b8-b2bb331be5b6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.021122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.061041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d1e45-0115-4977-bc58-91c004c99f63 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 70/133] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:36 2022] PUT /identity/v3/projects/37329022618f43cb8889d818637da14a/users/4dd7566ac1204db28ef70c6510a539b4/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fb04-e6c4-4384-95dc-ef111c103fd9 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fb04-e6c4-4384-95dc-ef111c103fd9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fb04-e6c4-4384-95dc-ef111c103fd9 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 71/134] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:37.094942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3fb04-e6c4-4384-95dc-ef111c103fd9 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.109995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.111231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.111660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.112078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.113744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:37.115701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e23a2c-6268-4218-905d-7c1dc04d4a5f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.120940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 64/135] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:36 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:37.122575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525c2d-20aa-4db5-be95-8cede32b1927 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.122982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525c2d-20aa-4db5-be95-8cede32b1927 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.123265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525c2d-20aa-4db5-be95-8cede32b1927 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.126776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 65/136] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:37.129988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.130564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.131225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.162791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:37.166516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:37.243879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.248451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3fb04-e6c4-4384-95dc-ef111c103fd9 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.269461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 66/137] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:37.270602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.289036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.289841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.290266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.290631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.291766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:37.293283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842f73a-65f8-4b4e-a3b2-ed0d4b780858 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.294912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 72/138] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:37 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:37.296020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.296857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.297275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.321340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:37.322650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:37.348240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.400905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:37.400905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.427334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213e05-74cd-4681-bb31-e5600a07cbcb None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.496727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.497403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.497682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.497954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/4dd7566ac1204db28ef70c6510a539b4/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.502105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, user_id=4dd7566ac1204db28ef70c6510a539b4, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:37.503577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.552181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.560394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000e894-a1b6-4da7-b8e5-b6235d07c142 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.599098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 67/140] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:37 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/4dd7566ac1204db28ef70c6510a539b4/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:37.603906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.604725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.605055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.605375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/4dd7566ac1204db28ef70c6510a539b4/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.608034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, user_id=4dd7566ac1204db28ef70c6510a539b4, role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:37.609714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.634905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.707204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 74/141] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:37 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/4dd7566ac1204db28ef70c6510a539b4/roles/475895c891594cd884efae065d6f7da7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:37.783440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbbf59-71f7-49ca-9ea6-2221e1692546 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.805132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.827469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.829266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.829802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.830282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.851545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:37.857223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:37.863963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:37.864800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 68/142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:37.868828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.872674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:38.018878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e0db-54c2-4f1b-b03c-5c9920f7decc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.021954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924311ec-c63b-45f6-9b2f-1d6f0462591a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.063554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.065541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.066205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.067714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.068847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:38.070208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.071861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.090482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 75/143] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:38.096269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.097182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.097664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.098139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.099533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.101912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:38.102985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.105225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 69/144] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:38.122209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:38.146344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:38.209397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:38.266850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0bdc-724a-494c-afbf-841f0ac60a28 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.305644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.306361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.306637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.307205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] PATH_INFO: `/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.308348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] RBAC: Authorizing `identity:get_user(user_id=91f3a068e72c4b288e9bd4d4313b6c8f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.309850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.312514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 76/145] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:38 2022] GET /identity/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:38.317604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:38.358558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a055d9c-5507-4c2c-9b1a-def6edf6a2a4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.424947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:38.433045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a15b-f90a-4865-b3f3-1cca7a3bed65 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.473334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.473964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.474246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.474527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.475207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.476696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17f97a-1a58-4d43-b0c3-278190da79fe None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.492805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.493457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.493729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.493996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.496558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.498187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.500756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 77/146] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:38 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:38.505930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:38.639185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 70/147] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:38 2022] POST /identity/v3/users => generated 283 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:33:38.655480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9614-9e92-4a00-b0a5-5c71ab79ff6f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:38.717478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:38.718912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.719219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.719445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/91f3a068e72c4b288e9bd4d4313b6c8f/roles/4a2a74169d6a4ff583d6007bee60fee8` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.721666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, user_id=91f3a068e72c4b288e9bd4d4313b6c8f, role_id=4a2a74169d6a4ff583d6007bee60fee8)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:38.723183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:38.744701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3fb3-1a90-4a76-b186-b0cf8383e90d None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.745027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3fb3-1a90-4a76-b186-b0cf8383e90d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.745297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3fb3-1a90-4a76-b186-b0cf8383e90d None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.746702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 71/148] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:38.752697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:38.752997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:38.753330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:38.786466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:38.787616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:38.831233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 78/149] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:38 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/users/91f3a068e72c4b288e9bd4d4313b6c8f/roles/4a2a74169d6a4ff583d6007bee60fee8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:33:38.880874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 72/150] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:39.173551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:39.193451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:39.303500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535d892-690d-445c-88ad-e9e9950c2ca9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:39.342330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:39.343491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:39.343772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:39.344041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:39.356142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:39.361582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:39.362433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:39.363214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 79/151] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:39.368739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:39.429049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:39.508068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc6f1-322b-4452-b743-3997eb4f9ae0 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:39.544980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:39.545622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:39.545944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:39.547131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:39.547582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:39.547896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:39.549373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:39.559308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 73/152] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:39.565592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:39.667446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:39.692527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b41e39-a149-4c23-8308-804ec828da42 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:39.732693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:39.733364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:39.734236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:39.734458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] PATH_INFO: `/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:39.737308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] RBAC: Authorizing `identity:get_user(user_id=bcff4f18a9994f58badcd6e80f8b0bfa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:39.738784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:39.740378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 80/153] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:39 2022] GET /identity/v3/users/bcff4f18a9994f58badcd6e80f8b0bfa => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:39.746692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:39.880331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:39.888726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adc8f-0ad0-4417-8b76-d508998b6fcc None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:39.931201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:39.931843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:39.932111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:39.932389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.028238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:40.029759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee8ff3-6da1-4570-ab4c-9957312ae806 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:40.144368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:40.153634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:40.160619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:40.176160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35aaf-ee32-4217-a2a0-f614c818a7e3 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.176486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35aaf-ee32-4217-a2a0-f614c818a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.177005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35aaf-ee32-4217-a2a0-f614c818a7e3 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.179001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 75/155] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:40.187551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04523e-2045-448e-bde2-578ba6249fcb None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.187551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04523e-2045-448e-bde2-578ba6249fcb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.187551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04523e-2045-448e-bde2-578ba6249fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.217565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4d04523e-2045-448e-bde2-578ba6249fcb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:40.219398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4d04523e-2045-448e-bde2-578ba6249fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:40.291704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a2589-dc40-4ef1-ad5c-a5f227997b35 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:40.333101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:40.334254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.334737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.335207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.336985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:40.339012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:40.341579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 81/156] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:40 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:40.350002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:40.350788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 76/157] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:40.366692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:40.458446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489550c3-d238-44df-9002-6b45e4112633 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:40.496456 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:40.497466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.497946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.498438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.499422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=bcff4f18a9994f58badcd6e80f8b0bfa) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:40.499946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:40.501684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abedb6e-b5dc-4b78-9109-5db08e811a81 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:40.508458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 82/158] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:40 2022] GET /identity/v3/role_assignments?user.id=bcff4f18a9994f58badcd6e80f8b0bfa&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:40.781602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b725ad1-346a-4887-87ef-3ed7b54e52e6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.782079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b725ad1-346a-4887-87ef-3ed7b54e52e6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.782353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b725ad1-346a-4887-87ef-3ed7b54e52e6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.783765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 77/159] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:40.789264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b835-9f44-4274-87ba-b3bec75a12f7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:40.789789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b835-9f44-4274-87ba-b3bec75a12f7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:40.790282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b835-9f44-4274-87ba-b3bec75a12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:40.817910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8a35b835-9f44-4274-87ba-b3bec75a12f7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:40.818417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b725ad1-346a-4887-87ef-3ed7b54e52e6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:40.819673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8a35b835-9f44-4274-87ba-b3bec75a12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:40.918157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 83/160] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:41.021859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b725ad1-346a-4887-87ef-3ed7b54e52e6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:41.047316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda122ec-39f7-4695-acd0-ff9606fbac9c None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.047899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda122ec-39f7-4695-acd0-ff9606fbac9c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.048370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda122ec-39f7-4695-acd0-ff9606fbac9c None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.049970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 84/161] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:33:41.055785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.056460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.056949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.057777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:41.080615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:41.080824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:41.080824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.080824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.080824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.089561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:41.091212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:41.097827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:41.103198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:41.113877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:41.114684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 78/162] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:41.117607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:41.243547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 85/163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:41.293685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4528-8d79-47f9-85cb-287d6f879a72 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:41.332076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:41.332644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.332933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.333209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.333883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:41.334191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:41.335671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:41.347142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 79/164] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:41.353236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:41.467383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562778af-6c63-4107-b046-acdb1a5f139d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:41.530854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:41.531810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.532094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.532407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.533666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:41.535133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:41.537120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 86/165] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:41 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:41.542897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:41.607151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:41.621286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:41.625738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:41.743645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33609365-a587-499d-a0c0-c7a3d7d8acb4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:41.776463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18788aa-8d57-4349-a248-8495e90a7769 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:41.830663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:41.831338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.831550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.831822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.889386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:41.890006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:41.890284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:41.890557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:41.925534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:41.930948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:41.931830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:41.932898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 87/166] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:41.935157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:41.937417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:41.938475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:41.996950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.059582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 80/167] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:33:42.060523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.061054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.126126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e1362-eda0-46f3-95ca-576220ad1fda None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.178760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.179689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.180142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.180657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.181670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:42.182218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:42.183830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:42.195821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fe6db-abf5-441c-9feb-9b08d8f35c3a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.203873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 88/168] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:42.204945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.231166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.231897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.232287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.232576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.254076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-a7c6d982-9c8f-4de5-818c-6ddb18e3bc09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:42.261645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:42.262578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:42.263384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:42.266543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 81/169] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:42.268071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93d75-a4ae-4c89-8153-0968ee6a2743 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.268495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93d75-a4ae-4c89-8153-0968ee6a2743 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.269263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c93d75-a4ae-4c89-8153-0968ee6a2743 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.275127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 82/170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:42.276159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c93d75-a4ae-4c89-8153-0968ee6a2743 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.282328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.419453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1bc30-dff2-4cc8-b82a-2c94929088f8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.449237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c93d75-a4ae-4c89-8153-0968ee6a2743 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.466073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.488019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.488678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.488959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.489215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.489354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] PATH_INFO: `/v3/projects/37329022618f43cb8889d818637da14a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.490275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.491655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.492129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.493376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] RBAC: Authorizing `identity:get_project(project_id=37329022618f43cb8889d818637da14a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:42.493807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:42.494852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:42.495741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff767d-997f-4c9d-b855-41f575ed562f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:42.500615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 89/171] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/projects/37329022618f43cb8889d818637da14a => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:42.500615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.502534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 83/172] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:42.504076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.504559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.505067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.527640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:42.535072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:42.609873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b5fe8-60ae-45e4-8768-7a1407d96403 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.665007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.665622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.665897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.666164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.667504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:42.667821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:42.670612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:42.683835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 84/173] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:42.685956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.690357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 90/174] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:42.691988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.692970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.773121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:42.829717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2b83-5a88-4e43-ac44-b70541b3d7ad None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.844968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbfadb-4ce2-4e63-9ab2-3bdaf9672efa None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:42.881829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.882439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.882716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.882977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:42.883775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=37329022618f43cb8889d818637da14a, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:42.884081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:42.885670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:42.892229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 91/175] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=37329022618f43cb8889d818637da14a&role.id=47fd5bc6d0614f6390457e9815727925 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:42.892971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:42.915189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:42.915844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:42.916091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:42.916358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.007549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31f2d3-5058-4921-8c71-b315e6d78e14 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.028849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.029686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.032135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f11b3-12db-4bf4-b83a-bb16f23a7709 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.034497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.045710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.047045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.047392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.047730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] PATH_INFO: `/v3/users/4dd7566ac1204db28ef70c6510a539b4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.049028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] RBAC: Authorizing `identity:get_user(user_id=4dd7566ac1204db28ef70c6510a539b4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.052077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d71b-3546-493c-b23b-3c86f151e573 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.053944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 92/176] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/users/4dd7566ac1204db28ef70c6510a539b4 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:43.055038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b953-6079-4ad8-bcef-375fd26ba451 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.055319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b953-6079-4ad8-bcef-375fd26ba451 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.055583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998b953-6079-4ad8-bcef-375fd26ba451 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.066867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 93/177] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:43.066867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b953-6079-4ad8-bcef-375fd26ba451 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.190257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 85/178] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:43.192167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.192520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.192885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.210761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998b953-6079-4ad8-bcef-375fd26ba451 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.215333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:43.216709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:43.255679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.256845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.257320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.257765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.302738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 86/179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:43.303692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.333011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.343683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.346138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.347830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.432349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782df52-1dd2-481a-8400-25fc5eb12e7f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.469894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 94/180] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:43.471469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.480756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.481459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.481737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.482004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.495305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-f0859942-896b-41ee-8f75-c34539f5d216 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:43.502046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:43.502983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 87/181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:43.504362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb648e4-9720-46ea-8a33-3ce07c605465 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.505280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb648e4-9720-46ea-8a33-3ce07c605465 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.505280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb648e4-9720-46ea-8a33-3ce07c605465 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.506085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 88/182] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:43.506943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb648e4-9720-46ea-8a33-3ce07c605465 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.575213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.587596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff02e9-dc0d-4f56-ab9d-51731c30c39e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.643138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.643773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.644052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.644320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.645475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.646926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80016c9-43e3-41d6-8588-386c400ab802 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.648566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 95/183] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:43.649770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94992-fa0b-4c73-896f-012157e48df8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.650053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94992-fa0b-4c73-896f-012157e48df8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.650323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94992-fa0b-4c73-896f-012157e48df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.669335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d3e94992-fa0b-4c73-896f-012157e48df8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:43.670095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.670536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d3e94992-fa0b-4c73-896f-012157e48df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:43.680011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb648e4-9720-46ea-8a33-3ce07c605465 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.713341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.713964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.714241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.714507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.715608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.717086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.719093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 89/184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:43.720183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.737948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 96/185] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:43.739361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3f9-7304-4b7b-83c3-35683e892f6f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.739641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3f9-7304-4b7b-83c3-35683e892f6f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.739908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4da3f9-7304-4b7b-83c3-35683e892f6f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.741167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 97/186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:43.741861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da3f9-7304-4b7b-83c3-35683e892f6f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.836374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.836540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2c699-55de-4d26-b0d7-a124b6a6124b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.856050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4da3f9-7304-4b7b-83c3-35683e892f6f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:43.871547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.872158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.872439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.872757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.873429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:43.873757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:43.875905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:43.888567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 90/187] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:43.888567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.899059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:43.899969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:43.899969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:43.900217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:43.911725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:43.912771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:43.916559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:43.917622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:43.918457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 98/188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:43.919112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:43.997030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e620-8b33-46e3-a1e6-9b4f283974a0 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.029902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.030548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.030827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.031098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.031818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:44.032120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.033020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05eed4-28d3-48fb-8cca-f902b131bdc1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.033584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23129-2073-4a5f-80ca-a8a77423701b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.039129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 91/189] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.041141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.041141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.041141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.062256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:44.063498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:44.074907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.076125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.076959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.077458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.078358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=4dd7566ac1204db28ef70c6510a539b4) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:44.078812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.080440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.093317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 99/190] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:43 2022] GET /identity/v3/role_assignments?user.id=4dd7566ac1204db28ef70c6510a539b4&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=475895c891594cd884efae065d6f7da7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.094367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.113793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.143673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 92/191] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:44.144982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.225931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2fef-ba9f-4166-9e42-37fe872085b0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.261395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c48c-71fb-448a-8f3e-3562e520f207 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.266923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.267619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.267902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.268167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] PATH_INFO: `/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.269455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] RBAC: Authorizing `identity:get_user(user_id=91f3a068e72c4b288e9bd4d4313b6c8f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.270942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.272983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 100/192] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/users/91f3a068e72c4b288e9bd4d4313b6c8f => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.273834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.306714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.307874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.308263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.308670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.309437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:44.309864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.311328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.330843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 93/193] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.331991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.379351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.405288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17508cf9-d626-47ba-84d9-9e1c345f4446 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.434728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.445266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.446173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.446612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.447037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.460658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:44.460980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde0c3-ea22-450c-aee8-c58e2fa6c877 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:44.468708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:44.469602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 101/194] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:44.471696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.496988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.497599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.497871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.498138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.564419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.565968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.573847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097e1b6-89a9-4e58-9908-01d880b96808 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.607669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.608305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.609267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.609543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.617534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.623091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.624676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.626359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 102/195] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.627126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.644631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.666491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 94/196] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:44.667499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.725037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5535-b9d7-4ec9-8c18-e7d8d3089637 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.758167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.758791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.759065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.759330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.760414 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.761893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.763445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 103/197] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.766127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.767224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2f79f-f689-4827-9c27-ee24c3c74040 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.800941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.801541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.801815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.802086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.802744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:44.803042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.804406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.812180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 95/198] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.813065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.832186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.855566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:44.869734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993bef5-ee21-427b-8554-224bcb982000 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.903514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.904119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.904393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.904695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.919314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506df95-cb27-46f6-8792-7a875fd06636 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:44.954193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:44.954193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:44.954193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:44.954193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:44.954938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.956377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:44.962925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 96/199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:44.962925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:44.981932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:44.983932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.043543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.059982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefef5-1e2e-4bd2-b0e1-6e4e3a76b351 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.069518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.084747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 104/200] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:45.085590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.094925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f329f-823b-447c-8251-9062d9249227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.095534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f329f-823b-447c-8251-9062d9249227 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.095806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f329f-823b-447c-8251-9062d9249227 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.096070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f329f-823b-447c-8251-9062d9249227 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.096808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f329f-823b-447c-8251-9062d9249227 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.098228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f329f-823b-447c-8251-9062d9249227 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.184781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17385-2ac7-46e7-8650-bb1bd82ccf7a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.215868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 97/201] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:44 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:45.216724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f329f-823b-447c-8251-9062d9249227 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.220020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.220928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.221201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.221465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.222700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.224203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.226167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 105/202] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:45.226735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.264117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.341016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e23a-3fcd-47b6-9067-d1ad9f558b5a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.342535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f329f-823b-447c-8251-9062d9249227 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.382577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.383101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.383244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.383481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.383717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.383825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.383996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.384265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.384934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.385138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, scope.project.id=1c1e76e502084a1e9a57166f4721355b, user.id=91f3a068e72c4b288e9bd4d4313b6c8f) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:45.385468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.386388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.388239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.388351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 106/203] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:45.389074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.393498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 98/204] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/role_assignments?user.id=91f3a068e72c4b288e9bd4d4313b6c8f&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:45.395574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.431326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.538918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.543254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29a502-4be0-4592-8d33-36619712aeaa None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.547517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2085-f47f-4dd9-8a6a-60232ad1f4c4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.595011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.595740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.596016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.596119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.596283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.596738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.597018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.597354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.598183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=31f7da8e37aa44a0b7369b2ffd3a162e) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:45.598488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.601076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.610413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 99/205] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/role_assignments?user.id=31f7da8e37aa44a0b7369b2ffd3a162e&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:45.684289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.685823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.795725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.799747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 107/206] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:45.805137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:45.905438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:45.914548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b74b7-4a3b-4f08-a88b-3ff2c3d95c1e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:45.950923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:45.951817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:45.952182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:45.955457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:45.955457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:45.956030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6ebdb-a9b8-4dd0-a2a6-18c867b7c146 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:45.962774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 100/207] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:45.963777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:46.075528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b91cc-5f24-4d2a-bff6-9ecd74deec93 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:46.112442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:46.113083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:46.113412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:46.113715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:46.114472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=31f7da8e37aa44a0b7369b2ffd3a162e) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:46.114781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:46.116226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395931-e54d-4979-922b-405b493b1289 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:46.121941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 108/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:45 2022] GET /identity/v3/role_assignments?user.id=31f7da8e37aa44a0b7369b2ffd3a162e&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=475895c891594cd884efae065d6f7da7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:47.377138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559474-be43-43bc-b3b7-ed6614c94506 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.378103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559474-be43-43bc-b3b7-ed6614c94506 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.378601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88559474-be43-43bc-b3b7-ed6614c94506 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.380218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 101/209] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:47.385557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995a2e4-3d8e-4e8a-a12d-05ba7dde0d30 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.385945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995a2e4-3d8e-4e8a-a12d-05ba7dde0d30 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.386109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995a2e4-3d8e-4e8a-a12d-05ba7dde0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.404787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5995a2e4-3d8e-4e8a-a12d-05ba7dde0d30 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:47.406507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5995a2e4-3d8e-4e8a-a12d-05ba7dde0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:47.467715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:47.476743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 109/210] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:47.521955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd466b-cad3-495b-901d-8bdeda962102 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.522232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd466b-cad3-495b-901d-8bdeda962102 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.522503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd466b-cad3-495b-901d-8bdeda962102 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.524115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 102/211] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:47.529244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.529530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.529802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.549091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:47.551785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:47.602225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2af4-69bc-4968-b96c-77e612929cbb None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.602503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2af4-69bc-4968-b96c-77e612929cbb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.602776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2af4-69bc-4968-b96c-77e612929cbb None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.604253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 103/212] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:47.609305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.609660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.610006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.633240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:47.634077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 110/213] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:47.640888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:47.707350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 104/214] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:47.758494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:47.859423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b6dd9-d438-4a60-9e8f-6748b1789550 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:47.883173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:47.893693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:47.894323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:47.894605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:47.894921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:47.909781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:47.915118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:47.915995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:47.916843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 111/215] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:47.925756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:47.956046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.028158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.039020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986dd9-aad4-4bc3-9b8c-5e68ccd3358f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.070616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5712f-e550-41b1-8d6c-073755070b4f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.074973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.075690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.075963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.076489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.077238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:48.077541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.078925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.086975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 105/216] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:48.087750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.106244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.106867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.107237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.107406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.109082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.110528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b9a8-6f72-4ebc-b4ee-48afdbb526a9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.112216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 112/217] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:48.113345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a6d7-a22f-4b2b-8b67-7781fd181699 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.113615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a6d7-a22f-4b2b-8b67-7781fd181699 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.113874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364a6d7-a22f-4b2b-8b67-7781fd181699 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.115350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 113/218] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:48.116044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364a6d7-a22f-4b2b-8b67-7781fd181699 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.168347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.191949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655812-1776-42e2-8349-91c37099f99c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.215578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364a6d7-a22f-4b2b-8b67-7781fd181699 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.226168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.226797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.227074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.227346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.237778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:48.243024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:48.243903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:48.244743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 106/219] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:48.245410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.254747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.255377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.255655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.255921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] PATH_INFO: `/v3/users/9bf41b524ded40a493b72d7979da681c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.259724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.269900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf41b524ded40a493b72d7979da681c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.271380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49a1c2-b5e1-4e53-a7de-9d2f08907409 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.273115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 114/220] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/users/9bf41b524ded40a493b72d7979da681c => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:48.274264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.274539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.274894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.292357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:48.293565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:48.346215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778b8e6-11cf-45ad-a0fb-1010b4d809a8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.358206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 115/221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:48.359334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.379238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.379849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.380127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.380398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.381109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.382496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.401495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.458589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655566d9-5f5e-4dad-adee-5af435633b79 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.490826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.492808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.492808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.492808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.492808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:48.493086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.494333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.498644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 107/222] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:48 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:48.499674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.514024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 116/223] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:48.528638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.627177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.651107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce67a1-0c86-4f4d-ae36-e4bd57fe9572 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.652767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.671901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7dc1b-7866-4e2c-9032-9a5f4d211448 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.691742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.692556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.692692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.693570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.694058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.695516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.697294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 117/224] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:48.697977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.709377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.709971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.710249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.710516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.792335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:48.794164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:48.823243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf0f2c-4085-49fa-9317-8798d9fa7322 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:48.866871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:48.867512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:48.867785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:48.868109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:48.880002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:48.883529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:48.888453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:48.890050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:48.890950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 118/225] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:48.891619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.928408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 108/226] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:48.929599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:48.935530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.024490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b8ca-b215-49df-ba63-e7e9353a9cad None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.053367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23335d0a-e2d2-4d88-acee-16cdf2731db5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.061897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.062835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.063322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.063887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.065438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.067131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.069207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 119/227] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:49.070158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.090949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.091618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.091895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.092164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.092951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:49.093249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.094853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.103424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 109/228] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:49.108950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.143666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.184126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.189181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698c8e9-faf3-424e-a86c-945e8073d0fc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.226453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.227440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.227912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.228417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.229800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.231459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.233951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 120/229] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:49 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:49.234918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.241058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75d1b-5dfe-4dfd-bdbd-903c6d31de48 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.284996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.285994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.286538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.287005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/31f7da8e37aa44a0b7369b2ffd3a162e/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.289304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, user_id=31f7da8e37aa44a0b7369b2ffd3a162e, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.290950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.345466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff49c5-8af9-48e6-9215-6cdafb066f74 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.366432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 110/230] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:49 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/31f7da8e37aa44a0b7369b2ffd3a162e/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:49.368221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.384795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.385724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.386076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.386421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.387860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.389728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.391397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 121/231] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:49 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:49.397299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.438733 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.499988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.513601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81cf96-b7f7-4cd2-82c9-63afc66f8251 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.520240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eccfe-1dc6-42f7-a548-4ddcafe3ecb4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.555948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.556934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.557512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.558038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.559193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=9bf41b524ded40a493b72d7979da681c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:49.559706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.561153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.562463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c098ff8-21d2-4182-9bf2-0c8aebc5e4c2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.562648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.562954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.563308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.564616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.566271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.568436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 122/232] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:49 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:49.570776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 111/233] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:49 2022] GET /identity/v3/role_assignments?user.id=9bf41b524ded40a493b72d7979da681c&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:49.574323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:49.694862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d65a-b98a-4f4d-99f6-d4c5bd3bbbc3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:49.696492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:49.736155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:49.736875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:49.737157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:49.737430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/31f7da8e37aa44a0b7369b2ffd3a162e/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:49.739963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, user_id=31f7da8e37aa44a0b7369b2ffd3a162e, role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:49.741480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f8514-b2d1-4015-875d-4722bf2d382e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:49.851017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 123/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:49 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/31f7da8e37aa44a0b7369b2ffd3a162e/roles/475895c891594cd884efae065d6f7da7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:50.840519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62898-cfbb-419d-884a-f130fc1bd7c6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:50.841553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62898-cfbb-419d-884a-f130fc1bd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:50.842056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc62898-cfbb-419d-884a-f130fc1bd7c6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:50.844801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 112/235] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:50.850271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf50cc-c304-4b7f-b771-a7d0657feb70 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:50.851150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf50cc-c304-4b7f-b771-a7d0657feb70 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:50.851623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf50cc-c304-4b7f-b771-a7d0657feb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:50.872890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-83bf50cc-c304-4b7f-b771-a7d0657feb70 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:50.874930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-83bf50cc-c304-4b7f-b771-a7d0657feb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:50.970688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 124/236] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:51.029520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d72a-5ab8-4456-8a76-67a49d511dbf None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.029825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d72a-5ab8-4456-8a76-67a49d511dbf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.030590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d72a-5ab8-4456-8a76-67a49d511dbf None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.031932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 113/237] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:51.037605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.037890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.038164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.064713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:51.065884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:51.154035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 125/238] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:51.266237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3d72a-5ab8-4456-8a76-67a49d511dbf None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:51.406876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3d72a-5ab8-4456-8a76-67a49d511dbf None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:51.452638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:51.453276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.453550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.453819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.470840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:51.474617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:51.475508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:51.476341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 114/239] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:51.485439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:51.521581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:51.530059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:51.544125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:51.619443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdad96f-c56e-4a11-a01d-df8a684dbc08 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:51.677106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5982df-5059-443a-815f-3208316ccd3a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:51.711500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:51.712129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.712402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.712703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.713822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:51.715267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:51.716862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 115/240] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:51.722920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:51.729390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:51.730010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.730284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.730550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.731217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:51.731512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:51.741079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:51.758784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 126/241] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:51.777687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:51.829059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:51.838946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c7b7-0340-4f18-9985-e01f265d6863 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:51.877754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:51.878700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.878974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.879240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.879904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:51.881367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e3f0-beb9-4b92-a1f5-5f47cb1764e4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:51.951802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:51.971766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca7e3-e658-46d3-8255-6745508b79f4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:51.982179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 116/242] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:51 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:51.982179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af4-2f76-49ae-b5c7-2236ad145c9c None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.982179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af4-2f76-49ae-b5c7-2236ad145c9c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.983686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af4-2f76-49ae-b5c7-2236ad145c9c None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:51.985537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 117/243] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:51.991270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401e7c-6738-4674-9012-464eca385f8a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:51.991591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401e7c-6738-4674-9012-464eca385f8a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:51.991900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401e7c-6738-4674-9012-464eca385f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.032197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-79401e7c-6738-4674-9012-464eca385f8a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:52.035063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.035779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.036052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.036320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] PATH_INFO: `/v3/users/7388d988af39415e864e7a8dcf7b7ce4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.036995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-79401e7c-6738-4674-9012-464eca385f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:52.060362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] RBAC: Authorizing `identity:get_user(user_id=7388d988af39415e864e7a8dcf7b7ce4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:52.062293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ad0c3-e07e-464e-ac94-ab271c4990c3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:52.064567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 127/244] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:51 2022] GET /identity/v3/users/7388d988af39415e864e7a8dcf7b7ce4 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:52.065874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aff43-dc94-4de1-b0f1-0de94c2cb3f1 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.066157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aff43-dc94-4de1-b0f1-0de94c2cb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.066438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aff43-dc94-4de1-b0f1-0de94c2cb3f1 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.071342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 128/245] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:52.074308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.074599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.074876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.095728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:52.096997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:52.131166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 118/246] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:52.132051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401e7c-6738-4674-9012-464eca385f8a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.174483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 129/247] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:52.205327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.239173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401e7c-6738-4674-9012-464eca385f8a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.274480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.275114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.275496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.275764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.348089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:52.349574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee07c-af76-4ab1-a330-f7f8cd88b05f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:52.415979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.445674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.457642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 119/248] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:52.459883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca8c8-aa13-4709-bb15-424da262e437 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.460166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca8c8-aa13-4709-bb15-424da262e437 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.460428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ca8c8-aa13-4709-bb15-424da262e437 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.462007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 120/249] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:52.466879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ca8c8-aa13-4709-bb15-424da262e437 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.540232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.574491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba999f4-9f3a-4bc6-a289-79a2a48cff79 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.602290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ca8c8-aa13-4709-bb15-424da262e437 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.619117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.620152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.620438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.620878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.632757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-6875068a-f34c-4ce8-be06-e03743382e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:52.638721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:52.640619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:52.641659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 130/250] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:52.642530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.642530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.642530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.646980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.647907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.648358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.648827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.650425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:52.652117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:52.654190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 121/251] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:52.655554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.673341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:52.675321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:52.698694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.756867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 131/252] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:52.757854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.769748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736057a2-b8c2-42df-a76f-90a5c90c9051 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.806574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.807205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.807479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.807744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.818828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:52.823729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:52.824665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:33:52.825488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 122/253] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:52.826400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.832277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.900056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1125e-119b-4a0b-9318-179b7e85fe46 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.933295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:52.938276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9ff0b-3211-424d-aeca-994c2b5da11d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:52.974350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.975090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.975387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.975641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.976380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=7388d988af39415e864e7a8dcf7b7ce4) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:52.976716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:52.978209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:52.986372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:52.987647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:52.988136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:52.988632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:52.988760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 123/254] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/role_assignments?user.id=7388d988af39415e864e7a8dcf7b7ce4&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:52.989652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:52.989879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:52.990511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.000615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.019213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 132/255] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:53.024580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.119947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09da5-ad81-4cc6-a56d-ebdae1a8303c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.156754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.157372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.157650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.157927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.158595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:53.158891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.160328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.169540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 124/256] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:53.177719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.218859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:53.251850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ec64d-ca1d-4d51-9bda-1a937b94a27e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.293062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:53.315425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.316059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.316331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.316612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.317829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.319339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.320955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 133/257] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:53.326648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.365785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c557e-84c3-4a13-97dd-c359025488a6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.432372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.433035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.433314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.433569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] PATH_INFO: `/v3/users/9bf41b524ded40a493b72d7979da681c` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.435601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf41b524ded40a493b72d7979da681c)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.438638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.441258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 125/258] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/users/9bf41b524ded40a493b72d7979da681c => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:53.445979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.508139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bbea4-e1ed-4f5e-8707-1a680bc5b2b0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.557289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.557848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.558123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.558391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.570497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:53.577423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:53.578335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:53.579132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 134/259] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:53.579872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.650349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:53.668994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:53.669192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efbe7-52a3-43b1-ada8-3e01890d13d7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.739860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.740484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.740799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.741066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.760967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f94ad-7b06-41b7-9810-9a409192a66a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:53.827241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:53.827794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:53.828069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:53.828336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:53.831225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.832704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.834328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 135/260] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:53.835087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:53.860493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:53.861988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:53.963561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:53.975522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 126/261] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:53.976321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:54.063397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af5db-e809-41fd-8258-a9d8c9799908 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.090526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2d68f-2e6d-45c5-91df-008b0260e9b4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.112719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:54.129382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.130145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.130553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.130817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/9bf41b524ded40a493b72d7979da681c/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.132916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, user_id=9bf41b524ded40a493b72d7979da681c, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.134430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.143682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.144343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.144654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.144930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.145596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:54.146009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.147431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.157853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 136/262] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:54.158755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:54.208170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 127/263] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:53 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/9bf41b524ded40a493b72d7979da681c/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:33:54.209106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:54.290860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:54.320150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf088d4-b28b-458f-82f9-67a9899e8838 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.379051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9b406-5eb5-46bd-a386-95ed01b2b8bf None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.395125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.395779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.396056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.396321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.397557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.401200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.402931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 137/264] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:54 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:54.414991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:54.461417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.463508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.464504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.464799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] PATH_INFO: `/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.467026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] RBAC: Authorizing `identity:get_user(user_id=31f7da8e37aa44a0b7369b2ffd3a162e)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.469290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.473466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 128/265] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:54 2022] GET /identity/v3/users/31f7da8e37aa44a0b7369b2ffd3a162e => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:54.479959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:54.522719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:54.600557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824550-9de4-48b4-9edf-49253c28a8da None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.674262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:54.693183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380a3e-9fa7-4181-ac43-f321dcc7da16 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:54.705540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.706159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.706439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.706697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.782298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:54.782912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.783186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.783452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.784181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=31f7da8e37aa44a0b7369b2ffd3a162e) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:54.784482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.785964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01518b4a-058d-4783-a03e-cb4536f5c645 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.795740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:54.797658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:54.800271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 138/266] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:54 2022] GET /identity/v3/role_assignments?user.id=31f7da8e37aa44a0b7369b2ffd3a162e&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:54.803139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cad-eb09-4305-95a6-832d87e32378 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.803426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cad-eb09-4305-95a6-832d87e32378 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.803697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cad-eb09-4305-95a6-832d87e32378 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.806224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 139/267] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:54.817380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c081-cd1b-4396-8fd2-0cc793782f84 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.817698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c081-cd1b-4396-8fd2-0cc793782f84 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.817949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829c081-cd1b-4396-8fd2-0cc793782f84 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.820754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 140/268] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:54.821977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87012a-b6dd-4c34-862a-9239e91aa553 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.822256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87012a-b6dd-4c34-862a-9239e91aa553 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.822525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87012a-b6dd-4c34-862a-9239e91aa553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.860479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ae87012a-b6dd-4c34-862a-9239e91aa553 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:54.861755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ae87012a-b6dd-4c34-862a-9239e91aa553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:54.941297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 141/269] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:54.942499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:54.942784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:54.943054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:54.995100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:54.996314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:55.030915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 129/270] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:55.036555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.048467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:55.065028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:55.081564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 142/271] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:55.166055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eae4e-dbfd-4d7a-8bbd-1d0b5960c8d1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.204053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.204688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.204971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.205244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.206427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:55.207878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594db2b-1a5d-4e64-a646-927e1aa114da None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:55.209541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 130/272] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:55.215521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.331490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645917ab-24da-480d-b11d-565beec4d2b8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.371460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.372069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.372349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.372640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.373374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=31f7da8e37aa44a0b7369b2ffd3a162e) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:55.374412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:55.375994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344234-cb6c-479f-823f-ba7f2d7b2290 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:55.382511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 143/273] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/role_assignments?user.id=31f7da8e37aa44a0b7369b2ffd3a162e&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=475895c891594cd884efae065d6f7da7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:55.460323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e08903-a602-4683-97dc-461584726707 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.460510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e08903-a602-4683-97dc-461584726707 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.460811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e08903-a602-4683-97dc-461584726707 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.462218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 131/274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:55.469015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.469302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.469563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.491125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e08903-a602-4683-97dc-461584726707 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.496012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:55.497257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:55.552045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:55.610045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 144/275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:55.610938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.617155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:55.635309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e08903-a602-4683-97dc-461584726707 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.690168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.690799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.691070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.691338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.693118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:55.694546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:55.696270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 132/276] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:55.705988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.753414 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4d676-60a4-41a3-8783-61650948fc7c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.790726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.791358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.791690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.791962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.805608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:55.812422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:55.813420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:55.814256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:55.817373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 145/277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:55.822560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:55.850734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b4e78-5e0d-479e-b0b6-62271e7c6323 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.861130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:55.897714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.898324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.898600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.898867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.899519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:55.900991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:55.943165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183d34-a0c7-4e50-8ea1-b9466c64c10d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:55.977536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:55.978133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:55.978407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:55.978671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:55.979319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:55.979611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:55.981015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:55.989410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 146/278] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:55.990181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.017894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 133/279] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:33:55 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:56.021795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.040042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:56.104204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:56.118548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877917-79ab-4022-8afa-ccbdd17da22a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.160605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.161646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.162128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.162596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.163670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7163376-e5ab-4c17-8d05-b89d308a022d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.176305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:56.181623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:56.182506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:56.183313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:56.185579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 147/280] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:56.193847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.209977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.210670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.210944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.211265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] PATH_INFO: `/v3/users/4e427f14402246aeb2465224aa09ba34` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.227360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] RBAC: Authorizing `identity:get_user(user_id=4e427f14402246aeb2465224aa09ba34)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.228966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.231732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 134/281] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:56 2022] GET /identity/v3/users/4e427f14402246aeb2465224aa09ba34 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:56.239549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.323738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3534-fd00-4169-ad38-a479340a0841 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.338222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:56.367896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.368440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.368755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.369023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.369690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:56.370025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.371765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.383683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aef64-9f8c-4758-93ea-90547bf2a000 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.384130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 148/282] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:56.388157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.408855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:56.432531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.433228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.433505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.433776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.434645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, user.id=4e427f14402246aeb2465224aa09ba34, scope.system=all) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:56.434953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.437221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.446572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 135/283] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 5 10:33:56 2022] GET /identity/v3/role_assignments?user.id=4e427f14402246aeb2465224aa09ba34&scope.system=all&role.id=47fd5bc6d0614f6390457e9815727925 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:56.520837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167126-f499-4167-967e-4fb31f415c47 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.563348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.564318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.564793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.565210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] PATH_INFO: `/v3/users/7388d988af39415e864e7a8dcf7b7ce4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.566572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] RBAC: Authorizing `identity:get_user(user_id=7388d988af39415e864e7a8dcf7b7ce4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.568277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb812993-0427-4640-b171-4b67253c6e33 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.570577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 149/284] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:56 2022] GET /identity/v3/users/7388d988af39415e864e7a8dcf7b7ce4 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:56.577014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.697787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b84a-de60-4794-937a-b2b75c4f2a12 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.698423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b84a-de60-4794-937a-b2b75c4f2a12 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.698937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b84a-de60-4794-937a-b2b75c4f2a12 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.700510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 150/285] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:56.711563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840176-54cf-4fdd-8985-12b268281f78 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.715454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.715739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.716011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.739040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:56.740236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:56.748084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:56.754380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.755413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.755894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.756364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.757976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.759637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.761969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 136/286] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:56 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:56.768116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:56.819945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 151/287] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:56.882678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9982-71a2-4cd5-a9f5-77e4a34fa5ce None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:56.918593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:56.919617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:56.920151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:56.921178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/7388d988af39415e864e7a8dcf7b7ce4/roles/4a2a74169d6a4ff583d6007bee60fee8` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:56.923322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, user_id=7388d988af39415e864e7a8dcf7b7ce4, role_id=4a2a74169d6a4ff583d6007bee60fee8)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:56.924996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:56.995407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 137/288] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:33:56 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/users/7388d988af39415e864e7a8dcf7b7ce4/roles/4a2a74169d6a4ff583d6007bee60fee8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:33:57.120537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:57.134524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:57.247156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17a26e-3331-4f63-9dc8-a6fee6ba7d1f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:57.287623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:57.288686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:57.289165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:57.289629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:57.300393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:57.305467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:57.306436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:57.307247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:57.309891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 152/289] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:57.316259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:57.383879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:57.429947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5aa50-835c-4c0e-8aca-1117ac6ddabd None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:57.465897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:57.466964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:57.467471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:57.468085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:57.468993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:57.469518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:57.471117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:57.485087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 138/290] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:57.488406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:57.580032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:57.619380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e243a0c-1ee0-4e93-8b06-3ca902677a44 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:57.668136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:57.669187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:57.669710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:57.670174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] PATH_INFO: `/v3/users/9bf41b524ded40a493b72d7979da681c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:57.677027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf41b524ded40a493b72d7979da681c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:57.678729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:57.680677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 153/291] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:57 2022] GET /identity/v3/users/9bf41b524ded40a493b72d7979da681c => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:57.686935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:57.799940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047431-b6a2-47c2-afe6-30b59a230eb7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:57.829135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:57.836821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:57.837749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:57.838227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:57.838689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:57.912914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:57.914771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:58.021318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 139/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:33:58.030401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:58.159673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90d174-a5bb-465e-b9c8-4823ce8cb906 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:58.195136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:58.195769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.196043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.196309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.197455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:58.198906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e3f0-31ee-4602-acfe-efc11d8111e7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:58.200843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 154/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:33:58 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:58.207341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:58.246703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:58.354289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc5b28-9e20-4364-ae29-dd203bb0f70a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:58.393691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:58.394304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.394580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.394852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.395590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=9bf41b524ded40a493b72d7979da681c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:58.395894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:58.397355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bfe6f-f40a-4bb5-aba7-ffdb1943c200 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:58.409775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 140/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:33:58 2022] GET /identity/v3/role_assignments?user.id=9bf41b524ded40a493b72d7979da681c&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:58.513895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fbf7-5f3e-4662-a009-19a62d88f4d9 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.514234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fbf7-5f3e-4662-a009-19a62d88f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.514529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fbf7-5f3e-4662-a009-19a62d88f4d9 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.516477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 155/295] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:58.522024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8ecf-05f5-451f-af31-0ecbd3619ef7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.522325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8ecf-05f5-451f-af31-0ecbd3619ef7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.522563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b8ecf-05f5-451f-af31-0ecbd3619ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.544187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b70b8ecf-05f5-451f-af31-0ecbd3619ef7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:58.546472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b70b8ecf-05f5-451f-af31-0ecbd3619ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:58.638660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 141/296] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:33:58.851107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf18-cd41-460b-8186-8e9c11705602 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.851443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf18-cd41-460b-8186-8e9c11705602 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.851559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3faf18-cd41-460b-8186-8e9c11705602 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.852947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 156/297] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:58.858942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e5739-017c-47d5-a61b-cb1a5d3178fa None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.859226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e5739-017c-47d5-a61b-cb1a5d3178fa None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.859500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e5739-017c-47d5-a61b-cb1a5d3178fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.878733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ad4e5739-017c-47d5-a61b-cb1a5d3178fa None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:58.879915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ad4e5739-017c-47d5-a61b-cb1a5d3178fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:58.891434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:58.925796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3faf18-cd41-460b-8186-8e9c11705602 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:58.935719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:58.973495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 142/298] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:58.974677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653bcaf-db54-432c-a560-be3db979cf8e None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.974956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653bcaf-db54-432c-a560-be3db979cf8e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.975284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653bcaf-db54-432c-a560-be3db979cf8e None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:58.976714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 143/299] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:58.981815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:58.982209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:58.982372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.013602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:59.015766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:59.075648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3faf18-cd41-460b-8186-8e9c11705602 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.106795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 144/300] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:33:59.119314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.119947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.120222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.120488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.131066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:59.136309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:59.137205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:59.138015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 157/301] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:33:59.145365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.223192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.246539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a235-d5ec-460c-a960-83e1f2a39806 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.260933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.288761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.289811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.290369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.290835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.291702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:59.292300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.294101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.303656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 145/302] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:59.311992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.333953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.373170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2b96-ef64-4579-a65c-62e530ef5ac8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.410650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.411376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.411651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.411919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.419682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111e5cb-622a-40ab-95ce-6e450a7fd671 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.422700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:33:59.428801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:33:59.429732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:33:59.430659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:33:59.434399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 158/303] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:33:59.435197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.457838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.458710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.458986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.459249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] PATH_INFO: `/v3/users/4213010b157640009e4905424e1523c0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.467665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.474050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] RBAC: Authorizing `identity:get_user(user_id=4213010b157640009e4905424e1523c0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.475500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.482213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 146/304] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/users/4213010b157640009e4905424e1523c0 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:33:59.483073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.543333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce5c6-9b4f-4b57-83bb-fcb0b2edb628 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.573969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.583735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.584366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.584674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.584947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.586054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.587521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.589467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 159/305] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:59.590052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.595131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b418-254a-4dce-95aa-d63990040150 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.631875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.632423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.632718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.632989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.633700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:59.634000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.635386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.643765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 147/306] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:59.644538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.691200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18df4-6d8b-4a50-a855-a4db02fce087 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.705676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.724889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.725490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.725765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.726032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.726746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, user.id=4213010b157640009e4905424e1523c0, scope.system=all) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:33:59.727043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.728472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129a37-83cb-4699-a4a6-acae6d04e0b9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.733532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 160/307] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/role_assignments?user.id=4213010b157640009e4905424e1523c0&scope.system=all&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:59.734740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3d5-3e2b-442d-88a6-02e0f20fee6d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.735026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3d5-3e2b-442d-88a6-02e0f20fee6d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.735295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c3d5-3e2b-442d-88a6-02e0f20fee6d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.740562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 161/308] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:59.740562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c3d5-3e2b-442d-88a6-02e0f20fee6d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.752828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796f703-78e2-43a8-ae57-28d907d622d1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.793531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.794453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.794453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.794736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] PATH_INFO: `/v3/groups` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.795484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.797057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.808870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:59.853611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c3d5-3e2b-442d-88a6-02e0f20fee6d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:59.889603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:59.890152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.890429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.890702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] PATH_INFO: `/v3/users/4e427f14402246aeb2465224aa09ba34` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.891825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] RBAC: Authorizing `identity:get_user(user_id=4e427f14402246aeb2465224aa09ba34)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:59.893315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11885835-bec1-4410-ab44-da972ec96b8a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:59.894923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 162/309] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:33:59 2022] GET /identity/v3/users/4e427f14402246aeb2465224aa09ba34 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:33:59.896024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:59.896289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:59.896571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:59.909978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 148/310] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 5 10:33:59 2022] POST /identity/v3/groups => generated 229 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:33:59.911215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:59.914499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:59.915719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:00.020493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 163/311] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:00.044915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4834c1-ce4b-415d-abeb-085d50259911 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:00.066366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:00.083728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:00.084398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:00.084717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:00.084978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] PATH_INFO: `/v3/system/users/4e427f14402246aeb2465224aa09ba34/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:00.086416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e427f14402246aeb2465224aa09ba34, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:00.087801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:00.178470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 149/312] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 5 10:33:59 2022] PUT /identity/v3/system/users/4e427f14402246aeb2465224aa09ba34/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:00.300290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:00.362267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:00.407827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b3c5b-41cc-4333-82ac-ec9da42c3b7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:00.444343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:00.444926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:00.445202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:00.445475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:00.457289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:00.462462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:00.463360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:00.464172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:00.468717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 164/313] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:00.470526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:00.577120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a4c25-3000-4bba-8cef-b356e4a49c0f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:00.614470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:00.615191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:00.615616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:00.615891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:00.616568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:00.616897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:00.618270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:00.632455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 150/314] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:00.633763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:00.741054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a70d3-71b9-4424-89b2-23c4a66423f2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:00.758549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:00.777164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:00.777795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:00.778071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:00.778339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] PATH_INFO: `/v3/users/7388d988af39415e864e7a8dcf7b7ce4` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:00.779502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] RBAC: Authorizing `identity:get_user(user_id=7388d988af39415e864e7a8dcf7b7ce4)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:00.781699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:00.788049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 165/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:34:00 2022] GET /identity/v3/users/7388d988af39415e864e7a8dcf7b7ce4 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:00.789440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:00.840648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:00.899856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2999f4-7916-4c18-8e9a-2bd755fc3df6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:00.935161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:00.935808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:00.936271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:00.936703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.007133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:01.008524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:01.054893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:01.118835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 151/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:01.120206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:01.226243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad3a1-e0bd-40d2-8861-1757564771af None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:01.262590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:01.263196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.263476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.263743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.265695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:01.267139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cba59e-5145-41fd-a51c-228882b2da22 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:01.272710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 166/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:01 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:01.275089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:01.383129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612eac1-ccbe-4ad4-bf4f-456fda09514f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:01.418728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:01.419329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.419605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.419875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.421389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b, user.id=7388d988af39415e864e7a8dcf7b7ce4) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:01.421696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:01.423128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941fa0-1823-42ec-ad69-2eaaf7fa7866 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:01.434382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 152/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:01 2022] GET /identity/v3/role_assignments?user.id=7388d988af39415e864e7a8dcf7b7ce4&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:01.705018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a401d6-76d8-43e1-8170-e348b2584983 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.705534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a401d6-76d8-43e1-8170-e348b2584983 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.705534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a401d6-76d8-43e1-8170-e348b2584983 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.706937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 167/319] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:01.711989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638b77-947d-4a4f-9fea-2dd7fade00f7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.712372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638b77-947d-4a4f-9fea-2dd7fade00f7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.712544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7638b77-947d-4a4f-9fea-2dd7fade00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.731365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f7638b77-947d-4a4f-9fea-2dd7fade00f7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:01.732618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f7638b77-947d-4a4f-9fea-2dd7fade00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:01.735373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:01.804372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 153/320] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:01.945521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456309f-a674-4761-bc68-f52982de58c6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.945910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456309f-a674-4761-bc68-f52982de58c6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.946088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456309f-a674-4761-bc68-f52982de58c6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.948542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 168/321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:01.954045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8351-07dc-46b0-a622-9a7e3bf191aa None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:01.954303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8351-07dc-46b0-a622-9a7e3bf191aa None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:01.954695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8351-07dc-46b0-a622-9a7e3bf191aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:01.976130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-269c8351-07dc-46b0-a622-9a7e3bf191aa None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:01.977358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-269c8351-07dc-46b0-a622-9a7e3bf191aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:02.048625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 154/322] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:02.076089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456309f-a674-4761-bc68-f52982de58c6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.132663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.181520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456309f-a674-4761-bc68-f52982de58c6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.184471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a0cf-d28b-4698-9a54-7d2cfecadd03 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.184891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a0cf-d28b-4698-9a54-7d2cfecadd03 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.185239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a0cf-d28b-4698-9a54-7d2cfecadd03 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.186871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 155/323] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:02.191848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.192133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.192409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.211104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:02.212201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:02.218442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.219144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.219426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.219697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.231005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:02.236374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:02.237481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:02.238848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 169/324] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:02.243113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.278405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.284504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 156/325] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:02.314637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.350754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ba52-001a-4afa-8b60-6d84fb98eafe None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.365194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.387029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.387673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.387944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.388208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.389494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:02.389798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.391324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.404781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 170/326] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:02.407562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.419864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993063af-ba30-4e26-88ef-88be462ffe6e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.454798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.455425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.455705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.455973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.457128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.458555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.460125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 157/327] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:02.465486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.517792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60346-8a46-414a-a83e-118cd031ebd3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.531195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.552947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.553918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.554368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.554807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] PATH_INFO: `/v3/users/4213010b157640009e4905424e1523c0` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.556116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] RBAC: Authorizing `identity:get_user(user_id=4213010b157640009e4905424e1523c0)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.557781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.559570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 171/328] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/users/4213010b157640009e4905424e1523c0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:02.560498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.565567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e08e4-d492-48a7-9681-ae7cd0f55fef None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.600921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.601523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.601803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.602075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] PATH_INFO: `/v3/groups` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.602703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.604123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.604994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.660933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42f4-f37b-4114-b40c-f73e63d1cc84 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.704889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.705594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.706504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.706504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.716402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:02.716670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 158/329] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 5 10:34:02 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:34:02.717810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:02.721890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:02.723053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:02.725635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 172/330] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:02.729437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.842550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd025-6230-4775-a0ce-ceda91a76aa9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.847391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784dc4-27d1-4128-838b-805444fbbfe0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:02.851938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.872638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:02.882497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.883236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.883524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.883807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] PATH_INFO: `/v3/system/users/4213010b157640009e4905424e1523c0/roles/4a2a74169d6a4ff583d6007bee60fee8` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.885294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4213010b157640009e4905424e1523c0, role_id=4a2a74169d6a4ff583d6007bee60fee8)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.886678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.894393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:02.895011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:02.895287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:02.895555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:02.896215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:02.896515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:02.897933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:02.906388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 173/331] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:02.911878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:02.947328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 159/332] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 5 10:34:02 2022] PUT /identity/v3/system/users/4213010b157640009e4905424e1523c0/roles/4a2a74169d6a4ff583d6007bee60fee8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:03.035863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e2803-cdb4-4d52-be63-98d69e9e7c9a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:03.080278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:03.081157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:03.081530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:03.081924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] PATH_INFO: `/v3/users/4e427f14402246aeb2465224aa09ba34` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:03.083226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] RBAC: Authorizing `identity:get_user(user_id=4e427f14402246aeb2465224aa09ba34)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:03.084843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f064b-926e-405f-9d76-f73c999e0022 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:03.086876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 174/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:34:02 2022] GET /identity/v3/users/4e427f14402246aeb2465224aa09ba34 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:03.093477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:03.205966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e5cf-7b14-49a4-9a56-52bf79b53ea4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:03.242751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:03.243359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:03.243631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:03.243895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:03.244719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] RBAC: Adding query filter params (role.id=47fd5bc6d0614f6390457e9815727925, user.id=4e427f14402246aeb2465224aa09ba34, scope.system=all) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:03.245023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:03.246467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf300-32fd-4976-9276-2ad6ad610758 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:03.259645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 160/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 5 10:34:03 2022] GET /identity/v3/role_assignments?user.id=4e427f14402246aeb2465224aa09ba34&scope.system=all&role.id=47fd5bc6d0614f6390457e9815727925 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:04.989963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b7c-18e1-4984-8f73-805a4b2dc47d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:04.990513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b7c-18e1-4984-8f73-805a4b2dc47d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:04.990513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b7c-18e1-4984-8f73-805a4b2dc47d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:04.992072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 175/335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:04.997261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4209f-1629-4642-bcfd-36f5f725a2e9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:04.997695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4209f-1629-4642-bcfd-36f5f725a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:04.997875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4209f-1629-4642-bcfd-36f5f725a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.020764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-caa4209f-1629-4642-bcfd-36f5f725a2e9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:05.021963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-caa4209f-1629-4642-bcfd-36f5f725a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:05.085140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:05.113982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 161/336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:05.185084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ced88-104f-422e-be78-78a9ece0915f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.185430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ced88-104f-422e-be78-78a9ece0915f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.186249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ced88-104f-422e-be78-78a9ece0915f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.187841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 176/337] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:05.193410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d4fe-6f63-438c-9eb9-a6ac23af13b2 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.193691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d4fe-6f63-438c-9eb9-a6ac23af13b2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.193963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6d4fe-6f63-438c-9eb9-a6ac23af13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.223995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-67c6d4fe-6f63-438c-9eb9-a6ac23af13b2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:05.225120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-67c6d4fe-6f63-438c-9eb9-a6ac23af13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:05.302075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 162/338] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:05.443236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7559-3f93-4155-a634-631d4b310e19 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.443551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7559-3f93-4155-a634-631d4b310e19 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.443769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7559-3f93-4155-a634-631d4b310e19 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.445329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 177/339] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:05.451544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.451867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.452076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.477650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:05.478771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:05.558786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 163/340] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:05.577819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7559-3f93-4155-a634-631d4b310e19 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:05.612228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:05.701738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7559-3f93-4155-a634-631d4b310e19 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:05.742922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:05.743485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.743763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.744032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.758282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:05.761192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:05.766451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:05.767367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:05.768235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 178/341] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:05.770944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:05.843537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:05.901421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:05.911547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4764fb-c6ec-458a-93da-a41ca0ab4b33 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:05.914477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13905-e5c1-42fa-8893-da2e3ef82673 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:05.958730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:05.959759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.960259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.961093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.963052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:05.963052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.963052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.963052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.963808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:05.964107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:05.965542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c253f-0618-4001-b378-c8e0d8e3cc0e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:05.979474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 179/342] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:05.980264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:05.985775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24477-aae1-42eb-a637-3cde414a280d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:05.986099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24477-aae1-42eb-a637-3cde414a280d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:05.986373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24477-aae1-42eb-a637-3cde414a280d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:05.986856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:05.987737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:05.988903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:05.989525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 180/343] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:05.989525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24477-aae1-42eb-a637-3cde414a280d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:05.990659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 164/344] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:05.991333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.114521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630eda7-a182-4676-8295-717fa9ddad81 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.117118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.118523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24477-aae1-42eb-a637-3cde414a280d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.151525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.152175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.152453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.153355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] PATH_INFO: `/v3/users/4213010b157640009e4905424e1523c0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.158204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=4213010b157640009e4905424e1523c0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.159156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.159782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f11cb7-37b1-4395-b1dc-1004029ed2a6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.159896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.160210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.160550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.161809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 165/345] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:34:05 2022] GET /identity/v3/users/4213010b157640009e4905424e1523c0 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:06.163136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.163419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.168743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.177563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:06.183262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:06.184316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:06.185185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 181/346] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:06.186501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.190933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:06.192312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:06.207306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.276247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 166/347] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:06.277473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.308035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51abb99-1e3f-4c0f-a4bd-bb0652cbdf26 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.347954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.348574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.348887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.349155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.349828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:06.350128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.351534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.360383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 182/348] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:06.366878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.395250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b35358-4969-42e6-93a6-dde202e8c185 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.397250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.435110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.436398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.447770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.447770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.447770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] RBAC: Adding query filter params (role.id=4a2a74169d6a4ff583d6007bee60fee8, user.id=4213010b157640009e4905424e1523c0, scope.system=all) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:06.447770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.447770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.448142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.457896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 167/349] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/role_assignments?user.id=4213010b157640009e4905424e1523c0&scope.system=all&role.id=4a2a74169d6a4ff583d6007bee60fee8 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:06.458919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.474531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c833d7e-b9fb-4502-89c4-f06a7e5ecb1c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.514356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb026-47c3-418f-8021-e716db219311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.514959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb026-47c3-418f-8021-e716db219311 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.515235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb026-47c3-418f-8021-e716db219311 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.515505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fb026-47c3-418f-8021-e716db219311 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.516171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fb026-47c3-418f-8021-e716db219311 None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:06.516469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fb026-47c3-418f-8021-e716db219311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.517912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fb026-47c3-418f-8021-e716db219311 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.527245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 183/350] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:06.533676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb026-47c3-418f-8021-e716db219311 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.660150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67953666-bf05-4021-b801-65baa06fc504 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.690259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fb026-47c3-418f-8021-e716db219311 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:06.711119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.711962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.712388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.712832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.742395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.743601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:06.744321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:06.744823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:06.745102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:06.763489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:06.794311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.795798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.846707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:06.848664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:06.906366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 168/351] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:06.907227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:06.965397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.009269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 184/352] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:07.009927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.019747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898f83-02fc-4ff2-9114-5f8ef6d3b494 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.062177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.062653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.063617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.063888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.064148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.075827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:07.082224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:07.083168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:07.084023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 169/353] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:07.085579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.153637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830539a-1611-4e3a-8d19-7f30e115fb99 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.195922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.196563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.196864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.197129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.198347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.199786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.202359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 185/354] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.202872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.211559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15975ec0-181a-4984-b240-cd71879a6a7a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.226338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.250037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.250692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.250953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.251228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.252377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.253874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.255809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 170/355] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.256598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.331301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668069-c0a5-4a5f-a9e4-72c9b7532af6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.341130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.380658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.381278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.381555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.381825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.382493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:07.382794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.384183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.394281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 186/356] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.395111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.398250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0acb3-4b1b-4072-b6b9-9310c5a52c96 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.443841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.444949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.445227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.445499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.455465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.456956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.459714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 171/357] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.460525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.515330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1458b9-c79c-44d8-825d-cba486c9144c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.523630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.555331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.556235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.556519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.556811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.557961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.559526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.561922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 187/358] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.562711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.585987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff110f7-3f59-409a-9cfe-df84abb6c7b6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.607384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.628615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.629761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.630041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.630308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.691359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdcd-919b-48e4-a0d7-ff17322db456 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.711662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.713352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbe068-e2e4-4aac-8268-29f2fa11dff3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.732215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.733416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.733864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.734291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.735015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=475895c891594cd884efae065d6f7da7, scope.project.id=1c1e76e502084a1e9a57166f4721355b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:07.735320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.737715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ea53a-baa6-4876-a156-55908fa7efcf None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 188/359] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=475895c891594cd884efae065d6f7da7 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3b193-583d-4a37-886d-6694ffbc6b30 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3b193-583d-4a37-886d-6694ffbc6b30 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3b193-583d-4a37-886d-6694ffbc6b30 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 189/360] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:07.752683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341d01-a32b-485d-8b64-bc795423da7b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.753211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341d01-a32b-485d-8b64-bc795423da7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.753211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72341d01-a32b-485d-8b64-bc795423da7b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.755330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 190/361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:07.756313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72341d01-a32b-485d-8b64-bc795423da7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.772698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.849893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 172/362] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:07.851191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545bea-bc83-4a28-a61a-b3a14b0266b5 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.851478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545bea-bc83-4a28-a61a-b3a14b0266b5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.851740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545bea-bc83-4a28-a61a-b3a14b0266b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.874020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-01545bea-bc83-4a28-a61a-b3a14b0266b5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:07.875294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-01545bea-bc83-4a28-a61a-b3a14b0266b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:07.897833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:07.903682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72341d01-a32b-485d-8b64-bc795423da7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:07.959791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:07.960694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.961245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.962028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.962916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=1c1e76e502084a1e9a57166f4721355b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:07.963403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:07.965140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:07.966467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 173/363] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:07.970706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:07.971383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:07.971660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:07.974754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 191/364] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:07.975930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:07.992206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:07.993584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:08.096692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 174/365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:08.132966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169bda8-6918-4e3d-b77d-8d7adac24e3e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.186806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.187443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.187705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.187975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.189124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:08.190567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:08.192545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 192/366] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:07 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:08.198256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.211402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:08.335666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fe83f-35c9-42e4-8095-d95c7ac9f2d3 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.377673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.378245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.378518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.378787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.385283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:08.386752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:08.389292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 175/367] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:08.395750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.446869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:08.458119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.575899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b44f9-797b-460e-b2e5-2fe5dcd57ffa None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.591656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:08.628250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.628546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4719d56-4838-4be6-b064-6be0223d6ad1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.629418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.629915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.630382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.631321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:08.631884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:08.633573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:08.642841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 193/368] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:08.644105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.668853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.669515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.670768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.671057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.683883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:08.691362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:08.692351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:08.693449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 176/369] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:08.703228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.767119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:08.774645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8509048-1256-44f7-90df-c8c23bf068fc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.844309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.845013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.845296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.845571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.862231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:08.869265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:08.870170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:08.870977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 194/370] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:08.879002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:08.883394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d79e2-1033-44ba-96df-a09dcbb6d38d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:08.937107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:08.938032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:08.938495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:08.938973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:08.939841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:08.940325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:08.941969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:08.944705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:08.957615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 177/371] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:08.964079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.037210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2731c04-f4d6-40f5-8283-ee17b8ffed84 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.081773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.082983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.083454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.083917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:09.084799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:09.085282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:09.086992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:09.098911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 195/372] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:09.109932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.134055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:09.177145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5193d5-9761-4d33-b7c1-4170bb7b0485 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.225493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.226120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.226402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.226678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:09.235907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510225b-8bb6-4594-b753-a0bc0581db85 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.280616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.281575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.282053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.282507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:09.327879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:09.337034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:09.339906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:09.423700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:09.425539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:09.470061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:09.531449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 178/373] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:34:09.537922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.601608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 196/374] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:09.607767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.688545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:09.694939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb8ed-9a0f-491f-9a3b-8f84d021e321 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.732998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.733632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.733906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.734175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] PATH_INFO: `/v3/projects/5e124170ce0a463092ee8c909184559a` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:09.735318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=5e124170ce0a463092ee8c909184559a)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:09.736844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:09.738666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 179/375] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:09 2022] GET /identity/v3/projects/5e124170ce0a463092ee8c909184559a => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:09.743906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.772702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f3a34-a050-4366-a35c-5a161ee865b3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.798810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:09.830037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.830674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.830958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.831210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:09.832443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:09.833909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:09.835600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 197/376] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:09 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:09.841698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:09.934590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe13f75-bc88-47ad-8639-ebdda07a8ea4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:09.992014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:09.993107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:09.993593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:09.994074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] PATH_INFO: `/v3/groups/b64d3157df3c406c83446e9d7148f82f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.000470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] RBAC: Authorizing `identity:get_group(group_id=b64d3157df3c406c83446e9d7148f82f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:10.002260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:10.004442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 180/377] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:09 2022] GET /identity/v3/groups/b64d3157df3c406c83446e9d7148f82f => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:10.010469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:10.043851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:10.063317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c6f8b-886c-42b8-93df-7b870aec3585 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:10.107021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:10.108253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.108583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.108839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.110122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:10.111602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:10.114161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 198/378] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:09 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:10.123635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:10.127537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b33bb-3082-4f94-b52d-3b37cdb44ff7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:10.166579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:10.167526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.168131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.168645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.169580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] RBAC: Adding query filter params (group.id=b64d3157df3c406c83446e9d7148f82f, role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=5e124170ce0a463092ee8c909184559a) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:10.170606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:10.172442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcbe7-e6eb-4e97-8858-6aa98fb3e6c7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:10.184847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 181/379] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:10 2022] GET /identity/v3/role_assignments?group.id=b64d3157df3c406c83446e9d7148f82f&scope.project.id=5e124170ce0a463092ee8c909184559a&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:10.187512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02661a7-7910-4782-9513-e743ff65ac64 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.187797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02661a7-7910-4782-9513-e743ff65ac64 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.188071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02661a7-7910-4782-9513-e743ff65ac64 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.189877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 182/380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:10.196621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba72290-dfa0-44e3-9dc3-880a3fa13dbe None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.196621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba72290-dfa0-44e3-9dc3-880a3fa13dbe None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.196621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba72290-dfa0-44e3-9dc3-880a3fa13dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.214882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:10.229736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1ba72290-dfa0-44e3-9dc3-880a3fa13dbe None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:10.231188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1ba72290-dfa0-44e3-9dc3-880a3fa13dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:10.275520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdfb71-9772-45be-93df-ecfd11e914a0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:10.329940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:10.330931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.331433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.331905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.333431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=475895c891594cd884efae065d6f7da7, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:10.334009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:10.335712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59816-e549-4a8a-b3d8-a7c0434b25db None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:10.346495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 199/381] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:10 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=475895c891594cd884efae065d6f7da7 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:10.387183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 183/382] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:10.672334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff11c9-f420-4cae-b339-fe04a6fe33a6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.672999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff11c9-f420-4cae-b339-fe04a6fe33a6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.673487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff11c9-f420-4cae-b339-fe04a6fe33a6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.675297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 200/383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:10.680824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.681148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.681391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.709635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:10.710860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:10.730178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:10.788212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff11c9-f420-4cae-b339-fe04a6fe33a6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:10.798791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 184/384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:10.925779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff11c9-f420-4cae-b339-fe04a6fe33a6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:10.944898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:10.970810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:10.971450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:10.971725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:10.971994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:10.989577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:10.994675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:10.995574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:10.996394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 201/385] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:11.004276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.149171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fada6-18c7-46dc-83a1-9d8d3f6da0cc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.199672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.200674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.201526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.202176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.203060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:11.203571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.205183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.219488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 185/386] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:11.224701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.236472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.256372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:11.361553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44a52-17fe-4354-879f-69f6aee97943 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.384781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13504903-c588-4746-b62f-52eacbd51957 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.410948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.411600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.411879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.412149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.429471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-3075c1f5-7923-40d6-a3f0-59c80cc79147 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:11.434873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:11.435824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:11.437052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 186/387] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:11.437959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d38bc-df2b-4623-97ce-7b245ef8482b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.438035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d38bc-df2b-4623-97ce-7b245ef8482b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.438281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d38bc-df2b-4623-97ce-7b245ef8482b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.439792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 187/388] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:11.440397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.441518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.442013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.442481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.444776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d38bc-df2b-4623-97ce-7b245ef8482b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.445953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.447757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b08b2-3b17-49c6-aa3a-252233485903 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.450076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 202/389] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:11.451851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.452351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.452840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.477600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:11.479231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:11.527628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:11.537484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:11.557951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 203/390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:11.559150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.569616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d38bc-df2b-4623-97ce-7b245ef8482b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.621610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.622236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.622236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.622236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.624046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:11.624046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.625472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.638908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 188/391] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:11.644034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.674779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadad02-abeb-4e40-a492-91937960a467 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.714556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.715540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.716017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.716519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.718824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.720546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.726961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 204/392] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:11.729115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.788514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:11.824344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5dd7-6235-4cd8-983e-58ff89a420d0 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.842724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b528c-58ba-4e33-a852-25ccfb96c3b5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:11.880149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.880840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.881123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.881400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.883670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, group_id=6d706d26e37b402bb3f38b7688d273c1, role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.885529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.917673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:11.918319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:11.918683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:11.918965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:11.920725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:11.922210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:11.924396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 189/393] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:11.929717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:11.933624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:11.960712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 205/394] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 5 10:34:11 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/475895c891594cd884efae065d6f7da7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:12.043170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.086236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace0eda-132f-4ff2-8054-c072b52e9ee4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.157364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.158025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.158304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.158576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.160414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:12.161933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:12.166877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 190/395] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:11 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:12.173757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.210903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a68a8-c824-48c0-beca-56c747d39016 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.237853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:12.256129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.262260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.262260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.262260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.272149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:12.274438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:12.278284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:12.279360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:12.280778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 206/396] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:12.286004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.316386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b60d4-cdd3-4bf0-ae3c-84497724dc90 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.355939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.359389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.360005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.360494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.362750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e76e502084a1e9a57166f4721355b, group_id=6d706d26e37b402bb3f38b7688d273c1, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:12.364476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:12.413248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918675c6-b9de-401f-8a49-4cb4e6df19c5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.452125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 191/397] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 5 10:34:12 2022] PUT /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:12.461304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.462406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.462921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.463393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.464306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] RBAC: Adding query filter params (name=member) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:12.464830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:12.466543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:12.477512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 207/398] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:12.485980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.634716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ae6a0-2030-4520-b160-421a3fcad496 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.676175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:12.681792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.682563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.682845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.683116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.684315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:12.686361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e626f7f-227d-48fb-8f2a-050682f56a3d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:12.690242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 192/399] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:12 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:12.695008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.725344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:12.774132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b9df-4c91-487b-97cb-994d96095c46 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.774438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b9df-4c91-487b-97cb-994d96095c46 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.774689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b9df-4c91-487b-97cb-994d96095c46 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.776218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 193/400] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:34:12.782100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3172-4336-4f2c-bbfa-a4c569b93c13 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.782318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3172-4336-4f2c-bbfa-a4c569b93c13 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.782569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3172-4336-4f2c-bbfa-a4c569b93c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.805770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d42b3172-4336-4f2c-bbfa-a4c569b93c13 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:12.806966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d42b3172-4336-4f2c-bbfa-a4c569b93c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:12.809732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f710d6-4f55-4103-ac57-ae34076a1318 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:12.847219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:12.847855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.848130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.848401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.849568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:12.851027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:12.852855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 208/401] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:12 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:12.859138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:12.881010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 194/402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:12.906768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f134a-27b2-4d91-a6c0-d7e1d5a25dfb None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.907079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f134a-27b2-4d91-a6c0-d7e1d5a25dfb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.907312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f134a-27b2-4d91-a6c0-d7e1d5a25dfb None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.910024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 195/403] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:12.913997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:12.914280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:12.914552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:12.933646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:12.934846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:12.959421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:12.967340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4368aa6-4ec5-443a-b629-f6f7b9a87e4f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:13.003190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:13.003852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:13.004130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:13.004400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:13.006334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, group_id=6d706d26e37b402bb3f38b7688d273c1, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:13.007797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:13.064005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 196/404] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:13.109698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 209/405] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 5 10:34:12 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:13.231786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.312947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:13.359583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784bdd-db66-40d6-8b37-1a89a8e634ae None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:13.376404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.398689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:13.399643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:13.399928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:13.400201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:13.418428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:13.423358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:13.424292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:13.425271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:13.429319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 197/406] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:13.435006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.571635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339fc4c-0ff8-4876-9b50-516706405a3e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:13.619723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:13.620355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:13.620648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:13.620917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:13.644380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:13.649201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:13.651256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:13.653322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 210/407] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:13.659274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72baa889-0182-4452-b07d-89ee064e2be8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:13.661659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.688329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:13.708953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:13.733337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:13.734043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:13.734366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:13.734642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:13.735317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:13.735670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:13.737161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:13.751223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 198/408] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:13.752711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.784222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed8100-3689-4339-9054-9d42c88dcc05 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:13.828925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:13.830138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:13.830417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:13.830687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:13.831360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:13.831662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:13.835205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:13.855030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 211/409] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:13.862044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:13.970080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a11220-f46e-49bf-ab75-75456b902c2d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.003424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:14.037210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.039226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b9b4-9799-48ea-86f0-7fcab5e291a6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.040009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.040454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.040890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] PATH_INFO: `/v3/groups/b64d3157df3c406c83446e9d7148f82f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.043529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] RBAC: Authorizing `identity:get_group(group_id=b64d3157df3c406c83446e9d7148f82f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.046573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.052938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 199/410] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/groups/b64d3157df3c406c83446e9d7148f82f => generated 229 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:14.053905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:14.102889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.103434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.103696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.104320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.105657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.108406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.112757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 212/411] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:13 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:14.125594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:14.136160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:14.198074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ecff2-fad1-45d8-88d3-94afaeeebea4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.237029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.238160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.238641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.239444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] PATH_INFO: `/v3/projects/5e124170ce0a463092ee8c909184559a` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.241078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] RBAC: Authorizing `identity:get_project(project_id=5e124170ce0a463092ee8c909184559a)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.243001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.251117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 200/412] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:14 2022] GET /identity/v3/projects/5e124170ce0a463092ee8c909184559a => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:14.258713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:14.358233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17752a94-e1b6-4350-9947-43f6a8104615 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.410479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.411522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.411904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.412337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.414035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.415769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.418242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 213/413] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:14 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:14.424393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:14.429505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6480-a0f9-445e-9669-5dbc05f5f41d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.456772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:14.460996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:14.493551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.494250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.494527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.494869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] PATH_INFO: `/v3/projects/5e124170ce0a463092ee8c909184559a/groups/b64d3157df3c406c83446e9d7148f82f/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.502220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] RBAC: Authorizing `identity:create_grant(project_id=5e124170ce0a463092ee8c909184559a, group_id=b64d3157df3c406c83446e9d7148f82f, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.503901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa21b9-75ff-4847-8476-7df1dad318df None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.570238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e053-7986-492d-bc3a-3d28ffb57bdf None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:14.604802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:14.605439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.605715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.605984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.608372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] RBAC: Authorizing `identity:create_grant(project_id=74e71a95c3cf46d5bfade1d04fe86a8b, group_id=6d706d26e37b402bb3f38b7688d273c1, role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:14.609787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9770e1-ff53-4b7d-a99c-dd862a25bb37 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:14.627081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 201/414] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 5 10:34:14 2022] PUT /identity/v3/projects/5e124170ce0a463092ee8c909184559a/groups/b64d3157df3c406c83446e9d7148f82f/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:34:14.631773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfffb21-19a4-477e-a580-dafe40e8598a None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.631773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfffb21-19a4-477e-a580-dafe40e8598a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.631773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfffb21-19a4-477e-a580-dafe40e8598a None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.631773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 202/415] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:14.640437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd29a8-7063-4cf6-ac2c-d19398a30b01 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.640437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd29a8-7063-4cf6-ac2c-d19398a30b01 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.640437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd29a8-7063-4cf6-ac2c-d19398a30b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.665102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7fcd29a8-7063-4cf6-ac2c-d19398a30b01 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:14.667342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7fcd29a8-7063-4cf6-ac2c-d19398a30b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:14.748452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 214/416] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 5 10:34:14 2022] PUT /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b/groups/6d706d26e37b402bb3f38b7688d273c1/roles/475895c891594cd884efae065d6f7da7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:14.751776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 203/417] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:14.851056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748950-ad42-4a3c-9243-daece43520aa None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.851378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748950-ad42-4a3c-9243-daece43520aa None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.851601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748950-ad42-4a3c-9243-daece43520aa None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.853265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 215/418] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:14.859773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:14.860039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:14.860237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:14.881420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:14.882746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:14.974832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 204/419] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:15.056243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748950-ad42-4a3c-9243-daece43520aa None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.169310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:15.214281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748950-ad42-4a3c-9243-daece43520aa None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.251393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.270439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.271082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.271362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.271633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.283901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:15.288978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:15.290051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:15.291070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 216/420] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:15.296809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.327674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:15.456107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad430c-241a-4c0e-a60c-060a26f842c1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.456929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dccf90-7ffe-4d58-8ba3-5ad45eef0ce6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.524482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.531242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:15.531361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.531361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.531361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.531563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.531563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.531849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.532063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.532816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:15.533122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:15.539398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:15.550600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:15.555820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:15.557026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:15.557833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:15.558446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 205/421] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:15.563972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 217/422] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:15.569062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.570289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.700286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:15.705776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d600-cb10-4b58-948b-ed3cd2238118 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.706979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8cb24-6aea-4231-978f-de7719bbe975 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.742383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.743076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.743500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.743735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.752290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.753176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.753631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.754523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.755377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:15.755852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:15.758113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335f342-6957-4b26-b059-2c62ffaae199 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:15.769494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 206/423] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:15.770932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7700-cbed-4c54-803b-75b638847843 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.771380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7700-cbed-4c54-803b-75b638847843 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.771815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7700-cbed-4c54-803b-75b638847843 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.773229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 207/424] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:15.774568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a7700-cbed-4c54-803b-75b638847843 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:15.828097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:15.838127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:15.840429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b06bfd-5085-472d-b995-e09647143f50 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:15.892796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a7700-cbed-4c54-803b-75b638847843 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:15.939786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:15.941110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.941745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.942297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.954178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 218/425] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:34:15.955674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:15.956153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:15.956547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:15.977349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:15.978803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:15.985729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.035414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.037365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.073146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 219/426] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:16.074091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.121116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.206084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 208/427] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:16.212975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.288089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2e4cc-f593-42ab-b22c-d360c0067124 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.294326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.338483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc6c4-34e1-4fe4-975b-8e2b3992fa57 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.382264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.382904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.383187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.383458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.385360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.386813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.388484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 220/428] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.389168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.389823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.390107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.390376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] PATH_INFO: `/v3/projects/1c1e76e502084a1e9a57166f4721355b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.391541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] RBAC: Authorizing `identity:get_project(project_id=1c1e76e502084a1e9a57166f4721355b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.392986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.395444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.402167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 209/429] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/projects/1c1e76e502084a1e9a57166f4721355b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.404581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.508998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.514873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa194-1dd1-4fdb-b04f-1182705bf251 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.520416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb82af7-7da5-47d4-8c0b-974011d4fd2f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.544507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.553858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.554686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.555172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.555622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.557210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.558891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.566578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.566578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.566578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.566578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.566934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.567131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 210/430] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.567738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.568360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.569763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 221/431] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.570809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.678754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae623-8567-49d6-bfb2-345674a2780d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.687549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaac46-6bbe-4986-a1b7-daec1a848a31 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.717820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.719274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.719777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.720221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.728054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.728696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.728977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.729245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.730109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=1c1e76e502084a1e9a57166f4721355b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:16.730416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.731907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.733854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:16.744638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 222/432] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.744638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:16.745709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:16.746643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:34:16.747470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:16.750499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 211/433] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:16.766601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:16.771575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.869114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10d20-5ee4-47ef-93c7-0a0f41513c2d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.881034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:16.913672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.914294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.914568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.915775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.915775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=475895c891594cd884efae065d6f7da7, scope.project.id=1c1e76e502084a1e9a57166f4721355b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:16.915965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:16.917290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d994af2-f934-46db-af96-da9cef68c886 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:16.932627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 223/434] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=1c1e76e502084a1e9a57166f4721355b&role.id=475895c891594cd884efae065d6f7da7 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:16.932627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825048-71f3-431c-82c1-73a58bdb2fe1 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.932627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825048-71f3-431c-82c1-73a58bdb2fe1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.932627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825048-71f3-431c-82c1-73a58bdb2fe1 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.934790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 224/435] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:16.939664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabf53-7a3f-4ea8-894d-9113889107fe None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:16.941212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1005-a91c-4a16-b4a8-cf1d92e1ffab None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.941890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1005-a91c-4a16-b4a8-cf1d92e1ffab None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.943293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1005-a91c-4a16-b4a8-cf1d92e1ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:16.972041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9cda1005-a91c-4a16-b4a8-cf1d92e1ffab None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:16.973985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9cda1005-a91c-4a16-b4a8-cf1d92e1ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:16.998546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:16.999319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:16.999491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:16.999769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.000472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] RBAC: Adding query filter params (name=member) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:17.000804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.002209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424e89-37a2-4112-b4e0-34fce207227b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.012669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 212/436] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:17.014729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da503-334b-44d9-a036-832e7035ffa4 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.014905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da503-334b-44d9-a036-832e7035ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.015153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704da503-334b-44d9-a036-832e7035ffa4 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.021579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 213/437] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:17.022532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704da503-334b-44d9-a036-832e7035ffa4 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.071047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 225/438] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:17.072222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.072511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.072884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.098869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:17.100082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:17.121798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.170465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704da503-334b-44d9-a036-832e7035ffa4 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.198571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.215323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.215944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.216255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.216766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.222152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 226/439] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:17.287989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.289611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.395119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.398404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 214/440] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:17.406004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.426479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.530245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad481b-7a7c-40d2-8e19-1c6d62ae8b17 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.530432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3b7a0-ef89-426d-a994-1dff3bec1a18 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.571843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.572485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.572788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.573178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.573973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.574230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.574612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.574892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.575160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.576504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.578337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 215/441] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:17.579025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.586973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:17.592136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:17.593074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:17.593936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 227/442] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:17.594584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.606299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.666718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.681491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf60de-08c9-4545-8628-a2b2ffc2053d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.697455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee555-3891-4788-a7c3-a15ff0d1dde2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.715117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.715743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.716018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.716366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.726490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:17.730795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:17.731319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:17.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:17.733927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:17.735003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.735003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.735003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.735211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 216/443] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:17.735211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.738388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.739865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.745983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 228/444] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:17.745983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.817094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.833605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f8037-2b73-4832-8779-c2f4416b649f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.839133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f4f6a-49e2-4608-b8f0-2632cc330407 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.866332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.866935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.867210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.871354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.871354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:17.871354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.871354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.872770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:17.873467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:17.873744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:17.874015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:17.874673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:17.875416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:17.876801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:17.878335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 217/445] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:17.878959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.890025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 229/446] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:17.890025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:17.890755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:17.982213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9943-82f8-4a26-acbf-aca6b7d7f038 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:17.986617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04561-efe4-40f9-a3ab-b0f6e414e76c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.016953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.017553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.017831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.018100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.018820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=47fd5bc6d0614f6390457e9815727925, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:18.019124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.019807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.020406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.020552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.020714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.020985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.026191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 218/447] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=47fd5bc6d0614f6390457e9815727925 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:18.026965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.030531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.099951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.101471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.118681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.153474 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a4f98-cb9a-416b-8d43-6e96bae6e430 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.196231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.197037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.197312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.197874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.219726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 230/448] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:18.223970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.269793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.275857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.277342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.343450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0c5e8-7c33-4771-8957-ab81341f7470 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.359886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.384672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.385292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.385572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.385846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] PATH_INFO: `/v3/projects/5e124170ce0a463092ee8c909184559a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.387007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] RBAC: Authorizing `identity:get_project(project_id=5e124170ce0a463092ee8c909184559a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.388540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.390467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 231/449] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/projects/5e124170ce0a463092ee8c909184559a => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:18.394813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 219/450] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:18.397704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.399933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.494766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e613f8-33c4-42b0-8e74-65bf501c8adb None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.495070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4a21-21da-4e29-a31c-2dcaea8a8e40 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.502485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.528359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.528554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.529708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.529818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.529988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.530077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.530256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] PATH_INFO: `/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.530346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] PATH_INFO: `/v3/groups/b64d3157df3c406c83446e9d7148f82f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.531380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] RBAC: Authorizing `identity:get_project(project_id=74e71a95c3cf46d5bfade1d04fe86a8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.531482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] RBAC: Authorizing `identity:get_group(group_id=b64d3157df3c406c83446e9d7148f82f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.532828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.532935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.534433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 232/452] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/groups/b64d3157df3c406c83446e9d7148f82f => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:18.534521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 220/452] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/projects/74e71a95c3cf46d5bfade1d04fe86a8b => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:18.540047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.540374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.582674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.638991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6f44-363f-49e0-8f61-d41a53ed3ada None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.641428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57afd34-e49e-403d-b7d1-a77cbcacd2be None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.672340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.672988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.673259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.673523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] PATH_INFO: `/v3/groups/6d706d26e37b402bb3f38b7688d273c1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.674582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.674698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] RBAC: Authorizing `identity:get_group(group_id=6d706d26e37b402bb3f38b7688d273c1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.675178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.675450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.675717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.676089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.676431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] RBAC: Adding query filter params (group.id=b64d3157df3c406c83446e9d7148f82f, role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=5e124170ce0a463092ee8c909184559a) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:18.676765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.677675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 233/453] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/groups/6d706d26e37b402bb3f38b7688d273c1 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:18.678182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4712bf2-7d91-48a1-bbc0-4fab4192f594 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.683331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:18.692642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 221/454] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/role_assignments?group.id=b64d3157df3c406c83446e9d7148f82f&scope.project.id=5e124170ce0a463092ee8c909184559a&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:18.730174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:18.790585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ebb36-89d4-4e65-be3c-a0a42175463a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:18.826009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:18.826872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:18.827145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:18.827411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:18.828787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] RBAC: Adding query filter params (group.id=6d706d26e37b402bb3f38b7688d273c1, role.id=475895c891594cd884efae065d6f7da7, scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:18.829106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:18.830554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208f745-6a12-4c8e-809e-43d2df2bf6ca None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:18.836485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 234/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 5 10:34:18 2022] GET /identity/v3/role_assignments?group.id=6d706d26e37b402bb3f38b7688d273c1&scope.project.id=74e71a95c3cf46d5bfade1d04fe86a8b&role.id=475895c891594cd884efae065d6f7da7 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:21.255110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78baa-da28-4310-b88c-f0314d48e6ae None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.256096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78baa-da28-4310-b88c-f0314d48e6ae None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.256625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78baa-da28-4310-b88c-f0314d48e6ae None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.258419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 222/456] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:21.263997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9775-f1dc-4610-831b-2632b679aadf None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.264856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9775-f1dc-4610-831b-2632b679aadf None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.265339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9775-f1dc-4610-831b-2632b679aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.289163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b42c9775-f1dc-4610-831b-2632b679aadf None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:21.290679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b42c9775-f1dc-4610-831b-2632b679aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:21.371276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:21.398817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded93b-c242-4f73-83fb-611f9770bcbe None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.399421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded93b-c242-4f73-83fb-611f9770bcbe None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.399918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded93b-c242-4f73-83fb-611f9770bcbe None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.401705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 223/458] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:21.407346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.407632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.407902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.426978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:21.428150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:21.458940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:21.519108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 236/459] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:21.696824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded93b-c242-4f73-83fb-611f9770bcbe None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:21.827605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:21.867609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded93b-c242-4f73-83fb-611f9770bcbe None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:21.872999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:21.940810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:21.941468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.941746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.942014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.964814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:21.966853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-53aedcd1-da56-4290-84db-e755ef614eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:21.991720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:21.992767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:21.993644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:21.993644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:21.993644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:21.993816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 224/460] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:21.996610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785275c-8350-4e50-b90b-7129a3d11d59 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:21.996610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785275c-8350-4e50-b90b-7129a3d11d59 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:21.996610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785275c-8350-4e50-b90b-7129a3d11d59 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:21.996975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 225/461] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:21.999654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2f2c9-5ce5-45fd-9ccc-655f122ce7f7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.005894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785275c-8350-4e50-b90b-7129a3d11d59 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.040324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.040939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.041212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.041479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.053003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.054477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-aa4f05a2-821c-4f22-bea0-6043c34377a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:22.070784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:22.071737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:22.073259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:22.073259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.073259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:22.073259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 237/462] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:22.073259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b86fe-9904-4280-96a2-1166f572c982 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.073530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b86fe-9904-4280-96a2-1166f572c982 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.073596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b86fe-9904-4280-96a2-1166f572c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.093178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-cf9b86fe-9904-4280-96a2-1166f572c982 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:22.094277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cf9b86fe-9904-4280-96a2-1166f572c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:22.109273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:22.129315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785275c-8350-4e50-b90b-7129a3d11d59 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 238/463] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e958-cf18-4a19-834c-779b2eb94044 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e958-cf18-4a19-834c-779b2eb94044 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e958-cf18-4a19-834c-779b2eb94044 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 239/464] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:22.174314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e958-cf18-4a19-834c-779b2eb94044 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.175889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.176513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.176834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.177105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.177752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:22.178051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.179486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbc73a-db23-481f-a6b8-f9e3a96f8153 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.196502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 226/465] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:22.196502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.196502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.196502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.215682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:22.217599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:22.233987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:22.302143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e958-cf18-4a19-834c-779b2eb94044 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.312714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 227/466] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:22.314109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.353281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.354313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.354860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.355328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.356278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:22.356962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.359143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.378055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 240/467] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:22.383977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.402173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:22.502311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097ebf0-b174-405a-956c-61fb24062ef8 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.526834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b1d3-79ba-4bd9-aaf3-67a74d9e0abd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.543332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.545143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.545522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.545896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.546654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.548209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.567427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.568260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.568793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.569222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.570009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.571692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.668541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 228/468] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:22 2022] POST /identity/v3/users => generated 246 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:22.670284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.673014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:22.712296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 241/469] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:22 2022] POST /identity/v3/users => generated 248 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:22.713835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.805606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:22.838565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a293b-be29-4811-ba47-dfd51f05fc5d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.859162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e0b3c-7d15-4a4b-99b5-f593868a1309 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:22.883345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.884244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.884244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.884525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.900744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.902224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.908140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:22.909185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:22.909663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:22.910127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:22.921755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:22.922739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:22.923599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:22.923599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.923599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:22.923599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 229/470] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:22.926977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:22.928903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:22.929324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:22.962383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:22.963346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:22.964205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:22.964205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:22.964205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:22.966633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 242/471] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:22.972373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:23.012933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:23.069487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475dbf6-2166-474a-aa66-afdab818fd51 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:23.102635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab759f15-12ae-418a-a800-bd9a64f7058b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:23.112476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:23.113129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.113410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.113685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.114726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:23.115037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:23.117092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fd3fa-42dc-4dbd-aec5-996609fead49 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:23.121874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:23.132360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 230/472] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:23.133912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a6f0f-a7d8-4004-a233-ff4ebe913c52 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.134200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a6f0f-a7d8-4004-a233-ff4ebe913c52 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.134475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a6f0f-a7d8-4004-a233-ff4ebe913c52 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.135685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 231/473] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:23.138565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a6f0f-a7d8-4004-a233-ff4ebe913c52 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:23.148135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:23.148777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.149062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.149338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.149996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:23.150305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:23.151758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350661b-ea0d-4625-9b33-d618e05b45f2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:23.165992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 243/474] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:23.167447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.167775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.168048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.187410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:23.188603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:23.260707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a6f0f-a7d8-4004-a233-ff4ebe913c52 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:23.272746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 244/475] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:23.273635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:23.282174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:23.323617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:23.325428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.326645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.327066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.327894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:23.329609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:23.411311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68988-f6fb-4ee3-a7fc-5700b8989b1c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:23.423668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:23.449574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 232/476] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:23 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:23.457853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:23.458539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.458908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.459186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.460090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:23.461803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:23.570167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 245/477] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:23 2022] POST /identity/v3/users => generated 249 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:23.618082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:23.736143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad63b38-18e8-4542-b7aa-e018e0c2fd07 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:23.775299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:23.775918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:23.776198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:23.776470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:23.777188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:23.779101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:23.816742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.sql.core [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:34:23.816742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 10:34:23.816742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [parameters: {'id': 'ac73205b4d6f4e3b8a233cdff640ef56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 10:34:23.816742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93530) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result.read() Sep 05 10:34:23.839885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return ref.to_dict() Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:34:23.840860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application yield resource Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise self.value Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application session.commit() Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:34:23.842491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:34:23.843404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:34:23.844303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result.read() Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:34:23.845253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [parameters: {'id': 'ac73205b4d6f4e3b8a233cdff640ef56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:23.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 10:34:23.847046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:23.849321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 233/478] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 5 10:34:23 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:23.852224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:23.986048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c12270-9009-4366-b7c5-b6d94729d301 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:24.028214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:24.029563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:24.029850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:24.030124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:24.041099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-7a863355-d7ac-47fe-bfad-ba1e69b5bf5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:24.046634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:24.047543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:34:24.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:24.051436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 246/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:34:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:24.054097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:24.095030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:24.164578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e0616-cdf5-4467-92f5-d56b4dac7944 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:24.205499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:24.206134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:24.206411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:24.206682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:24.207365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:24.207667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:24.209113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7580d-9741-493b-b94c-78c42ccdf243 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:24.222896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 234/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:25.096907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82158f-f78c-4fab-a1b9-99762f0f898e None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.097408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82158f-f78c-4fab-a1b9-99762f0f898e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.097408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82158f-f78c-4fab-a1b9-99762f0f898e None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.099034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 247/481] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:25.104234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264ca-2794-4234-a200-aa45501d114e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.104646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264ca-2794-4234-a200-aa45501d114e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.104833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8264ca-2794-4234-a200-aa45501d114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.133573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6a8264ca-2794-4234-a200-aa45501d114e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:25.134785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6a8264ca-2794-4234-a200-aa45501d114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:25.232758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 235/482] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:25.288026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609045e-01ad-4ac9-9b15-1595a3612658 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.288333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609045e-01ad-4ac9-9b15-1595a3612658 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.288574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609045e-01ad-4ac9-9b15-1595a3612658 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.290156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 248/483] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:25.295644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.295928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.296202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.321605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:25.322810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:25.345164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:25.401295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 236/484] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:25.603690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609045e-01ad-4ac9-9b15-1595a3612658 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:25.649030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:25.743041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:25.758964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609045e-01ad-4ac9-9b15-1595a3612658 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:25.805033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:25.805672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.805947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.806214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.831921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:25.844373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:25.845353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:25.846466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 249/485] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:25.853060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:25.927815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edbd9c-bf6b-46f4-b078-37a924d43c60 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:25.973848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:25.976631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:25.977840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:25.978293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:25.978737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:25.993116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24593-3d78-47f0-a3a2-b6e43499ca28 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:25.993776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5269ee5f-48ce-42c0-87a1-e678dd191f3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:26.000332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.001513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:26.002510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:26.005185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 237/486] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.011538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6283-5f09-4993-9440-3bbc7cdcdbd7 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.011980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6283-5f09-4993-9440-3bbc7cdcdbd7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.012765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d6283-5f09-4993-9440-3bbc7cdcdbd7 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.014712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 238/487] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:26.015727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6283-5f09-4993-9440-3bbc7cdcdbd7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.037710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.038449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.038832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.039207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.039751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.040096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:26.040644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.042229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8a8ed-a8cd-4517-b54d-1e33f71e7b30 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.053858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 250/488] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:26.055256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.060770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.061246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.080868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:26.082054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:26.142744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d6283-5f09-4993-9440-3bbc7cdcdbd7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.157853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 251/489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:26.165599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.181814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.182489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.182839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.183206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.183952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:26.184372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.186457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ff9dc-5b7c-45ed-bd95-85f4527c4c9e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.199887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 239/490] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:26.199887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e308e1-df9f-4f44-98c3-383312d54cef None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.199887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e308e1-df9f-4f44-98c3-383312d54cef None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.199887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e308e1-df9f-4f44-98c3-383312d54cef None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.199887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 240/491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:26.202330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e308e1-df9f-4f44-98c3-383312d54cef None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.266527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.294131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b36a4d-ae35-477c-9217-a4d2f7cce4d0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.310623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.336328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e308e1-df9f-4f44-98c3-383312d54cef None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.337829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.338595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.338982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.340099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.351254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.353617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a5893731-c282-45e2-9830-e8ea53bea8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:26.369163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.370196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:26.371052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:26.371052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:26.371052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:26.376294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 252/492] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.377761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.378048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.378320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.378569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.379407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.379889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.380344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.393927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.395690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.398430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:26.399632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:26.412227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.413191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:26.414131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:26.414131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:26.414131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:26.420692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 241/493] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.421782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.478957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 253/494] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:26.480544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.537646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800588-bad7-4583-bd5b-7b8238ba7b53 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.556031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.574467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.582032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.582651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.583199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.583199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.583806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:26.584100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.585498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.597960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 242/495] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:26.598946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.617243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75a63-0304-4560-9839-8bcb459f3108 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.654405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.655049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.655338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.655619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.656290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:26.656612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.658200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.672035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 254/496] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:26.672922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.721948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c3628-3d79-41b3-97ac-2095b099795b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.761396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.761943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.762575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.762891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.774013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:26.779028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.780107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:26.781133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 243/497] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.781962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.789601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337784b-7c9b-49ae-add7-3df6e82af656 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.806987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.824220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.824873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.825165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.825430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.836051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:26.836214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.836214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c6ec2178-3d30-4a46-953c-02a403f5f067 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:26.846541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.847539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:26.848451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 255/498] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.849059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86426-4603-4aa4-9ec2-8b49b3cd5dc4 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.849059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86426-4603-4aa4-9ec2-8b49b3cd5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.849320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec86426-4603-4aa4-9ec2-8b49b3cd5dc4 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.850655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 256/499] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:26.851180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86426-4603-4aa4-9ec2-8b49b3cd5dc4 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.887538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3586e-5945-4e67-b498-016dc49cbcf3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.922326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.922944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.923218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.923494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] PATH_INFO: `/v3/users/glance` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:26.930280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:26.931711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:26.944949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:26.946040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 244/500] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:26.947385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:26.958924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec86426-4603-4aa4-9ec2-8b49b3cd5dc4 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:26.993643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724701-81a5-477a-af9f-005068861807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:26.994269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724701-81a5-477a-af9f-005068861807 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:26.994547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724701-81a5-477a-af9f-005068861807 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:26.994820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724701-81a5-477a-af9f-005068861807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.005363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55724701-81a5-477a-af9f-005068861807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-55724701-81a5-477a-af9f-005068861807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:27.010684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:27.011627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:27.012451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 257/501] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:27.013290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724701-81a5-477a-af9f-005068861807 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.048399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.051098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86e5e3-d441-4a70-aef3-0d347388452a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.062247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.086624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.087226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.087915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.088199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.088914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:27.089223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.090969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef7e4-f4e2-4e02-bac1-efd9ec662c85 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.100171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 245/502] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:27.101442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.101733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.102009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.112477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724701-81a5-477a-af9f-005068861807 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.121202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:27.123135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:27.146290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.146884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.147157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.147419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.148131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:27.148428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.149890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.185532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 258/503] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:27.186370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.191248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 246/504] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:27.192316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.292386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.296667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc30345-b92d-44d2-90f4-2ad1badfb134 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.298293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.301291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c265112-3f87-45d2-84b0-d443989cea04 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.331655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.332260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.332533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.332829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.333492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:27.333790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.335139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.343125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 247/505] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:27.343874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.344050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.344929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.345340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.345734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.346808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:27.348023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.349641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.375425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 259/506] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:27.376562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.449388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceb92c-a0fd-43b7-8db7-7e335b5a8ab1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.481172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c816-ffea-40c7-921d-e4027be7626c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.484078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.484743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.485021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.485290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.496485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.498374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:27.512382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:27.514062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:27.515364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:27.515364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.515364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:27.515364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 248/507] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:27.515364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.516358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.516996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.517272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.517540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.535493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.540025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.585376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.586768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.616491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b1d4-7308-4e0c-ba51-c99c957926ab None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.650459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.651061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.651333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.651601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.662718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.664288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:27.679026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:27.679927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:27.680791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:27.680791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.680791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:27.680791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 249/508] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:27.681289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.687384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 260/509] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:27.687384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.737298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.751219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.783726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48744f-bdb6-4ae8-8664-e2c971fc7cee None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.784906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401c0a9-3a8e-413c-ac5b-e36c60dea93d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.817234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.817858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.818154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.818422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.818746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.819346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.819621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.819887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.830060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.831534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:27.845400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:27.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:27.849635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:27.849635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:27.849635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:27.849635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 261/510] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:27.849635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:27.891087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.892543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.946446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f022de-e6e8-4fed-97c5-17c45b4d8244 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:27.953854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.960697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:27.984375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:27.985017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:27.985292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:27.985558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:27.986189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:27.986484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:27.987867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:27.993580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 250/511] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:27.994406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.003746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 262/512] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.003746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.091855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbb8fb-637f-4c49-b508-052eb144e81a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.101993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607b4d5-1295-45bc-a7d2-cdef2583133a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.125137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.125737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.126011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.126278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.126910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.127210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.128576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.135214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.135833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.136110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.136378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.140181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 251/513] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.141173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.148289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.149786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:28.164132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:28.165105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:28.166143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:28.166143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:28.166143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:28.166143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 263/514] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:28.166143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.171265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.187551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.242604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6477dc-503a-4ff2-a986-0dce6c353894 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.267955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad11d1-52be-4434-86f3-27c624f56f75 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.276110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.276739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.277023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.277295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.277935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.278389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.279779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.291339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 252/515] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.291959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.303137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.303759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.304034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.304299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.315085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.316530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:28.331089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:28.332003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:28.332913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:28.332913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:28.332913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:28.332913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 264/516] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:28.334056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.382691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.394491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93380e-406c-47d9-b299-f4ff16dbf8ae None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.400737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.428612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.429259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.429601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.429873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.434390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6b39-8f86-448d-b240-51090f3b8185 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.438013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.439508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:28.451552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:28.452463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:28.453406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 253/517] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:28.453977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.472297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.472957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.473254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.473510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.480906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.483355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:28.494598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:28.495527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:28.496424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 265/518] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:28.497570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.559358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c9c44-91ed-4c0d-95ac-b3a23a9a9b01 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.593667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.593667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.594383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.594643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.595288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.595733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.596995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.598416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386c0d3-262d-4dd0-aef7-1212cf69109d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.609224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 254/519] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.610023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.620062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.626519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.634148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.634694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.634971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.635243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.635893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.637369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.707379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2860b-b97c-4535-984a-dbf45dcedb5f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.740362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.740987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.741265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.741537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.742174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.742471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.743818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.747482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 266/520] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:28 2022] POST /identity/v3/users => generated 247 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:28.748304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.763019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 255/521] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.763912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.842734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:28.871829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c18ea-bec9-4898-9168-7a933d61433c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.881549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1030-c6bc-42b1-9c43-52dabe696cad None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:28.910510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.911147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.911423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.911687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.912688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.912796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.914156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.921600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:28.922495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:28.922776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:28.923048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:28.924004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:28.924368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:28.926711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:28.934665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 267/522] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.935749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.968274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 256/523] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:28.969230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:28.989458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.049323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005659-566f-4f33-aa21-e7bf97d64096 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.080035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956414d1-6076-40f9-b11d-60bb6b01f59b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.084318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.084980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.085260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.085530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.093203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.094663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:29.107423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:29.108342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:29.109262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 268/524] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:29.109794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.110688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.122150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.122959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.123470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.123761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.131905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.133374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:29.146848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:29.147838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 257/525] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:29.154049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.226172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b0599-ab72-42cd-ac67-d05aa3549f94 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.228403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.262192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795afd0-4dfe-431c-a528-197d7eeff7e8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.265179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.265788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.266776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.266776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.301971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.302573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.302851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.303120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.340776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.342419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.360700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.375147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.377108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.447973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 269/526] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:29.447973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.447973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.490472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 258/527] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:29.491528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.553680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78333f06-5768-43d2-b120-04e548c9d1d8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.585699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.593615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.594220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.594494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.594756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.595436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:29.595734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.597272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.600967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf260d-bb10-4bf2-b294-ba7104760644 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.620270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 270/528] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:29.620270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.643095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.643701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.643979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.644249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.644971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:29.645272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.646697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.670736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 259/529] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:29.670736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.689394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.733787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e50ad-00d0-445a-b2e2-1759a80b6370 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.771228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.771784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.772059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.772331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.778843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0f62-b8d6-4220-8349-346611890560 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.783330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.784828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:29.800740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:29.801706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:29.802604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:29.802604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:29.802604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:29.804888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 271/530] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:29.806326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.818239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.818871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.819154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.819432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.830440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.831876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.839256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:29.847426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:29.852657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:29.853696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:29.853696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:29.853696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:29.853696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 260/531] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:29.853696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:29.919708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eac12-3df2-4742-932a-6be313ba6396 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.933928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:29.960871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:29.961724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:29.962026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:29.962667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:29.963662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:29.963967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:29.966289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:29.968192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edef41-279c-4ccb-9297-ff88d25d3beb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:29.976896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 272/532] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:29.977780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.019269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.020225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.020647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.020988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.022467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=b0c38e0197d54850803f0cf9a3419dbc) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.022920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.024483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.034169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 261/533] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/role_assignments?user.id=b0c38e0197d54850803f0cf9a3419dbc&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:30.035741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.106478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb8e05-bff2-41a0-bfb0-cb5fc001e904 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.152759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.153638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.154013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.158109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.158109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.158109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.158109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.172604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 273/534] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:30.177365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:30.180858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.245181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:30.249217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dde239-ccbc-4373-a9f4-c0c5eec1ee3b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.290141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.291567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.292080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.292566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.293454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.294048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.295531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.308487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 262/535] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:30.321817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.329845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fcc60-eb5d-4a20-8af9-501c00cd753a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.374540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.375430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.375851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.376358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.384441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.386181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:30.400302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:30.401391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:30.402449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:30.404568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 274/536] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:30.410643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.522262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:30.526951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16c0b-47ba-48ef-bca8-02ea1be5eaec None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.573617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.574492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.574922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.575932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.577323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.577773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.579359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.583607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87305c-1a01-4ceb-95b0-b5280e28d17b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.595011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 275/537] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:30.601043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.638337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:30.686514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.687167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.687443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.687715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.709760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.711237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.715678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebced4c-3fd8-4b6f-ae47-db0e1e4ca49b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:30.738655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:30.739762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:30.740869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 263/538] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:30.762471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:30.765135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.765918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.766359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.766785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.767651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=e7dce5cc34ce4930ade1d9ba9e3bddd2) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.768105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.769702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b1ab-ac5d-49ef-ae1e-d5263c08fcd2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.776298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 276/539] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/role_assignments?user.id=e7dce5cc34ce4930ade1d9ba9e3bddd2&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:30.809018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191226-aab2-423f-a0a7-3953e4199e39 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.809874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191226-aab2-423f-a0a7-3953e4199e39 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.810292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191226-aab2-423f-a0a7-3953e4199e39 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.812032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 277/540] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:30.818563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.819068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.819510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.850059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:30.851593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:30.884089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:30.920159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8798de2-1ee3-4dd9-81f2-c6f840085f43 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:30.966893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:30.967763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:30.968233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:30.970977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:30.971757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:30.972086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:30.973569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:30.980259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 278/541] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:30.992615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 264/542] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:30.999150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:31.117220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde009c-f4c6-426e-838f-f1b790f55441 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:31.162233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:31.162856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:31.163134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:31.163406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:31.164142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=80d508c497124391ad6e0ff77a534b0d) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:31.164506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:31.165983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:31.177923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 279/543] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:30 2022] GET /identity/v3/role_assignments?user.id=80d508c497124391ad6e0ff77a534b0d&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:31.467703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:31.522325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:31.668272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d623a-0f83-49d2-9293-8ce82bc1f5cb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:31.708774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:31.709400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:31.709678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:31.709946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:31.724423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:31.733221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:31.734123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:31.734923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 265/544] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:31.740151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:31.771749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:31.896206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749c72-1500-4933-975e-cd4c38d9a1f7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:31.947290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:31.947918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:31.948196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:31.948468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:31.949168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:31.949466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:31.951758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:31.968154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 280/545] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:31.973334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.115540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234315f-6b7d-4411-bd18-8da53b7530f3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:32.117034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:32.166428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:32.167061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.167337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.167605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.182702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:32.184149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8481ce8a-ff3d-45a7-9411-13ccd09588bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:32.204031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:32.205103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:32.205960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:32.205960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:32.205960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:32.205960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 266/546] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:32.217720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.263911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc5d0-6d13-40d9-b537-eac89bc5b2f7 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.264219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc5d0-6d13-40d9-b537-eac89bc5b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.264453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc5d0-6d13-40d9-b537-eac89bc5b2f7 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.266850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 267/547] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:32.275788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.276072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.276344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.310829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:32.312027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:32.350892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:32.385749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ade465-7248-4c73-8cbf-5a473b501c6d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:32.411033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 268/548] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:32.451986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:32.452614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.452893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.453162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.453811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:32.454106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:32.455480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23c68-fa99-40ec-bc93-fd8528a97e5f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:32.474111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 281/549] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:32.479211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.558600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d151d5-90b4-4ea5-8f2c-9df0aa1c921b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.558905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d151d5-90b4-4ea5-8f2c-9df0aa1c921b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.559142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d151d5-90b4-4ea5-8f2c-9df0aa1c921b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.561851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 282/550] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:34:32.565769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.566048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.566329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.576969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:32.593866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d7705-44b2-45fc-b9fa-9e0fd4148b5a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:32.634154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:32.636487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:32.645347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:32.645994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.646275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.646547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] PATH_INFO: `/v3/users/swift` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.656697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:32.658151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:32.681337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:32.682338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:32.683359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 269/551] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:32.688695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.775859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 283/552] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:32.776844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.838483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae681ccf-6b3d-41f4-9272-b3a152062dae None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:32.863828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:32.890095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:32.890680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.891276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.891550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.892281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:32.892582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:32.894706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:32.899611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7cf79-f3bc-48db-a74b-ba9079e86384 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:32.918415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 270/553] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:32.925170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:32.928414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:32.949112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:32.950425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:32.951083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:32.951868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:32.970519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:32.975782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:32.976992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:32.977936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:32.980443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 284/554] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:32.986865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.054530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30e075-2f3a-433e-927b-05443e88dd0a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.094944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614402e-eeb6-435e-8d56-71749e6d786f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.102297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.102903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.103197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.103955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.125618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.138677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.139410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.139689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.139984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.146115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:33.146115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.146115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aba01e-0f29-4639-b3a4-54d9a0a8a523 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.151126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 285/555] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:33.152313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d796-a440-46ee-8da7-4de6cdffc8e4 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.157729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d796-a440-46ee-8da7-4de6cdffc8e4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.158183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d796-a440-46ee-8da7-4de6cdffc8e4 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.163671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 286/556] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:33.163671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0d796-a440-46ee-8da7-4de6cdffc8e4 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.205311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.207007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30775-7147-4ff4-bc09-95b30fe21fa2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.209575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.285807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0d796-a440-46ee-8da7-4de6cdffc8e4 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.314999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 271/557] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:33.316318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.316628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.316903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.328067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.328733 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.329012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.329281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.335596 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:33.336809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:33.341020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.342609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:33.356976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:33.357951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:33.363469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:33.363469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:33.363469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:33.363469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 287/558] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:33.363469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.407865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.414686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 272/559] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:33.425521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.468841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.484335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b37a8-55ac-4b7a-a2bb-4b669d93c8ff None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.529075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.530125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.530958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.531431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.546045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:33.551374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b25f8b-c2e8-4ad7-a0cd-dd8013b4488c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:33.553003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:33.553938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:33.554776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:33.562859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 288/560] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:33.564334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.595693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.596520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.596932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.597306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.608430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.610507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:33.626234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:33.627515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:33.628619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:33.628619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:33.628619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:33.630085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 273/561] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:33.635348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.689788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72102-237c-4fad-9a40-3fcea95dd09b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.691399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.724716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.725963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.726241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.726514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.727159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:33.727458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.728891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.740718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 289/562] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:33.741542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.745673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.763823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a007-f66a-423b-adbd-86b98e6f81fe None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.798401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.798998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.799273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.799541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.800201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:33.800494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.801879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.810465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 274/563] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:33.811097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.848359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b702937-95eb-420f-bd16-ce8f93717bb7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.881954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.882617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.882897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.883172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.883810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:33.884112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:33.885514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:33.897824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 290/564] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:33.898631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.918929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f971c9-0fa3-4d4b-9839-ae1cf52baf83 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:33.922470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:33.953324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:33.953887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.954229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.954475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.969537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-1d385964-9458-49b3-ade2-a58f88183175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:33.974952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:33.975926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 275/565] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:33.981866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b00b-084f-469c-a77f-fab32ad76a9a None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:33.982776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b00b-084f-469c-a77f-fab32ad76a9a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:33.982776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b00b-084f-469c-a77f-fab32ad76a9a None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:33.982776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 276/566] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:33.982776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018b00b-084f-469c-a77f-fab32ad76a9a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:33.991485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.007827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b26-73de-4b07-a843-5d25f1171613 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.043591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.044319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.044607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.044893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.051735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.053218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:34.065223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.066347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:34.067287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 291/567] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.067893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.089160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018b00b-084f-469c-a77f-fab32ad76a9a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.121297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.122462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.122732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.123002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.133005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.134452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.147373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:34.148970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.150035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:34.151342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:34.151342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.151342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:34.151342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 277/568] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.151342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.170981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8c92-01f1-440e-b534-9017dfbd2e35 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.205857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.206413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.206690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.206956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.213633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.214467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.215085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-89f2926f-3e06-4aec-abb9-879dcbbf79aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:34.226165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.228462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 292/569] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.229581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.230189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.247557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:34.248857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:34.260372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856098f-c744-4396-ade2-feb911dc484f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.296788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.297392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.297671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.297941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.298600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:34.298899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.300259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.307981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 278/570] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:34.308794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.318619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 293/571] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:34.319449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.391508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.410497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10292-a624-411b-9419-d3d3255cc814 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.422676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b36f-9b67-4505-b48a-4e78042f6465 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.430690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.445645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.446269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.446547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.446815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.447829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:34.447829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.449373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.464124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.465138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.465702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.466159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.466838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:34.467248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.468741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.474423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 279/572] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:34.474423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 294/573] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:34.486215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.583875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08474c-6982-46db-8e85-b71b8c8dabd1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.590957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ccd1-1198-4049-89f7-6d8a064e1cb8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.619551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.620159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.620312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.620441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.620752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.621442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:34.621812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.623230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.625174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.625800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.626071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.626336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.634470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 280/574] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:34.635368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.637685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.639368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:34.654293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.655416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:34.656509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:34.656509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.656509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:34.658403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 295/575] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.659098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.676870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.736528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd9bd-06e5-492b-8da9-1daf03986d7a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.756947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991ea6-c4c5-4eb9-be5b-7c120f32887a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.769724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.770354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.770630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.770902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.782439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.783951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.790235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.791236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.791512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.791774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:34.799388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.800515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:34.801486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:34.801486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:34.801486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:34.801670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.801744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 281/576] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.801812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.801881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:34.815019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.816218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 296/577] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.817405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.862331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.902210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:34.911625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb50e-51f5-4c2c-80e5-d10761c7685e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.917696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518b0b3-0ce2-4230-90f7-796e546f0c8a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:34.946993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.947615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.947892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.948165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.957422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:34.958029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:34.958303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:34.962160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:34.962160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=38ca2939be224113a823b0bbba092f0c) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:34.962160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:34.962160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:34.963866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:34.966633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 297/578] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/role_assignments?user.id=38ca2939be224113a823b0bbba092f0c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:34.967415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:34.969341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:34.970465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:34.971364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 282/579] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:34.972070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.090872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff3616-6e1d-43e3-b211-e9afab1f2a7b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.100652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.115866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393754b-0640-4763-b417-2234502b9e29 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.129247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.130040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.130932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.131211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.131870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.132171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.133594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.148631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 298/580] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.148631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.154856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.155473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.155745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.156016 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.156688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.156986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.158345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.175839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 283/581] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.175839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.190205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.249687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f4e79-0985-4865-a2ea-626441e09637 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.282245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0116d-0b7f-40bf-95b8-4ee4acf7b216 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.288204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.288848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.289131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.289406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.290142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.290447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.291885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.311116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 299/582] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.311960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.319915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.320528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.320828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.321093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.321757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.322054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.323826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.337282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 284/583] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.337282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.348443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.412966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.425541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e226e2-0732-419a-9828-7a63e23ea621 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.443687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf5eb-8bbc-44ca-b17a-3d743da3e6d0 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.463342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.463985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.464262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.464533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.472707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.474164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.480781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.482180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.482462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.482735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:35.486224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:35.487148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 300/584] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:35.493183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.495236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.497373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:35.509361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:35.510264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:35.511169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 285/585] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:35.512095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.590863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.606073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed72b-1a1c-44ec-ab1a-8e3b9ced3470 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.620309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc34ef-28cd-4cfd-8b18-3e1266d9b36c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.654626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.655639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.655996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.656342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.658073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.663298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.664104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.664548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.671638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.671924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.671924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.676183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.677738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:35.691230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:35.692299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:35.693318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:35.693318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:35.693318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:35.693506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:35.694382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:35.695317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:35.695317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:35.695317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:35.695317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 286/586] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:35.695317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.697837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 301/587] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:35.699634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.822664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07b61-a561-487b-9986-05218dab3eb3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.839097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba68b91-5f36-4535-be66-c93e9909dae1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:35.862400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.862928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.863206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.863478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.864329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.864667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.866163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.882746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:35.883454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:35.883929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:35.884152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:35.885008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:35.885389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:35.886340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 287/588] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.887012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:35.891678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:35.895496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:35.900674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 302/589] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:35.901572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.027761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f5d0-35ee-49b6-a256-d8521b808d70 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.034748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.039180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dea97-2433-49de-960d-f7829fd2e7cb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.078406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.079021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.079298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.079570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.080215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:36.080517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.082104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.086746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.087429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.087781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.088123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.089246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:36.089246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.091250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.100583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 303/590] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:36.100583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.105454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 288/591] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:36.107830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.170474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.218166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593c13-7b28-451b-88bc-16e82e76c31f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.220528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145e6a6-1f12-4a6a-88a9-f280d412576f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.222304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.254012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.254642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.254923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.255217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.255477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.256176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.256461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.256778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.266878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.268347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.274042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=a69da51c538a4e29ac81a774c36c4931, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.275561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:36.283752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:36.285015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:36.285954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:36.285954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:36.285954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:36.285954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 304/592] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:36.285954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.365050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 289/593] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:36 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:36.365982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.395241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8b1a-8c39-48de-9357-034bc06e1e25 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.408344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.436556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.437158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.437431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.437749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.447092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.448574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:36.461483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:36.462571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:36.463559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:36.467869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 305/594] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:36.468745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.521405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32cc-d54e-4e18-8eee-444967d65dce None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.571874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.572794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.573144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.573858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.583680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.585473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:36.599135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:36.603729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:36.605033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 290/595] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:36.605629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.610131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23161-a162-448b-b767-a857b01916f2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.624144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.651208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.652097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.652577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.653050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.654576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:36.655088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.656689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.671297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 306/596] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:36.676921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.711294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc30a7-51f4-40c9-8c01-d07a24e54bf0 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.712439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.747199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.747841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.748421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.748727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.749743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:36.750046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.752069 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.780683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 291/597] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:36.781791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.800887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f0ef6-9a32-4cdd-b56b-1d2b2c8d5ede None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.844571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.845268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.845541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.845805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.846491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:36.847211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.848973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.868749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 307/598] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:36.869843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.873091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.910599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5e31d-d06c-4ca7-b84b-cd41b923293e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:36.957057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:36.957817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:36.958200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:36.958733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:36.967169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:36.968884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:36.973695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:36.982436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:36.983521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:36.984632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:36.985714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 292/599] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:36.986934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:36.990822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f2d2-7444-4b06-9654-0b50b3155c65 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.029090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.030392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.030737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.031073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.041995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.043367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0f4a2cb4-4a26-4c67-ae48-3a1c26d3c632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:37.058562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:37.060497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:37.061628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:37.061628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:37.061628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:37.061840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 308/600] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:37.063065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc31b22-bb10-492f-9094-00ea59603f57 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.063421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc31b22-bb10-492f-9094-00ea59603f57 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.063761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc31b22-bb10-492f-9094-00ea59603f57 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.067666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 309/601] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:37.067666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc31b22-bb10-492f-9094-00ea59603f57 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.103785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed957e5-757c-4fcf-a163-fe7918d09588 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.135259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:37.141624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.146857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.146857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.146857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/b0c38e0197d54850803f0cf9a3419dbc/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.157296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=b0c38e0197d54850803f0cf9a3419dbc, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.158741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2008026-e60f-414d-9109-630bf0598534 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.176135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc31b22-bb10-492f-9094-00ea59603f57 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.210033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.210633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.210913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.211184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.211872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:37.212225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.213694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.225778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 310/602] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:37.226409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.233436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:37.244930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 293/603] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:36 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/b0c38e0197d54850803f0cf9a3419dbc/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:37.246444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.247438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.247717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.282552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:37.283876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:37.371348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 294/604] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:37.373840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.381354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daaeb6-b2eb-4c7f-bfd5-b21379661861 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.421244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.422076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.422479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.422897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.423854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:37.424183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.425814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.442883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 311/605] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:37.448370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.506137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58caa-d906-47a8-9f19-2efcbc595f64 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.515420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:37.518646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:37.544334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.545830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.545830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.545830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/e7dce5cc34ce4930ade1d9ba9e3bddd2/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.562051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffadcc-fa7d-4cdc-83b3-d02091e8ad7c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.565707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=e7dce5cc34ce4930ade1d9ba9e3bddd2, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.566795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.602309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.603148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.603600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.603995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.611649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.613353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:37.626225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:37.627236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:37.628184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 312/606] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:37.635247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.668990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 295/607] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:37 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/e7dce5cc34ce4930ade1d9ba9e3bddd2/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:37.670895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.787294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5272c-d3c6-4584-b672-0b532ace38b9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.832073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:37.851032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.851460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.851745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.852019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.852751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:37.853118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:37.854943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:37.869228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fe209-5157-474b-a1b4-3ec03efd0fa2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:37.870982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 313/608] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:37.877583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.926326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:37.926326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:37.926852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:37.927220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:37.952045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:37.962046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:37.963118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:37.963983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:37.968852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 296/609] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:37.970066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:37.994886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:38.089099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914840ab-8eef-4473-800e-aa0df821aeaf None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.131686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:38.132298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.132599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.132869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.135529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:38.135846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:38.137769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:38.145768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c5086-f3e6-404c-80ca-5ae450199f6b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.160135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 297/610] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:38.168248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:38.219164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:38.219833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.220112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.220383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/80d508c497124391ad6e0ff77a534b0d/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.250107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=80d508c497124391ad6e0ff77a534b0d, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:38.251582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:38.293983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:38.313432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e5e83-ac21-4ca0-8f1b-c19c05b324ad None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.356830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 314/611] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:37 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/80d508c497124391ad6e0ff77a534b0d/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:34:38.359023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:38.359983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.360469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.360969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.376490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:38.378420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-01d34ca8-5607-4a7e-8364-9b7d55506283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:38.396132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:38.397169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:38.398139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:38.398139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:38.398139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:38.400272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 298/612] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:38.406678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:38.428646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c508df-8023-458e-b666-ccc3041aa05f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.429003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c508df-8023-458e-b666-ccc3041aa05f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.429206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c508df-8023-458e-b666-ccc3041aa05f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.430834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 299/613] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:38.436934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.437255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.437495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.457938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:38.459200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:38.472156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:38.568529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 300/614] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:38.587140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee52b4-a570-445c-9afd-cce0788171d3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.625492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:38.626388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.626907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.627364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.628198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:38.628725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:38.630291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:38.645578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 315/615] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:38.650997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:38.727695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:38.777040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c9ad6-b483-42c4-a53a-d129602ae36d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.824131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:38.825148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:38.825637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:38.826096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] PATH_INFO: `/v3/users/swift` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:38.835050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:38.836745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:38.849729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:38.854682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:38.855801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:38.857693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:38.858296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 301/616] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:38.863279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:38.971480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:38.984912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147b91-a8e7-4a4b-bc67-bc550ad6ba07 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:38.988180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d505-978c-42f1-92e6-c15a08e7853c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.015556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.027061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.028452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.028822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.029200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.030036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:39.030434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.031960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.032422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.033226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.033644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.034226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.048531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:39.051724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 302/617] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:34:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:39.054570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:39.055499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:39.056518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:39.057207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.059615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 316/618] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:39.065328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.181315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca1bb5-c98b-489a-866c-f4ffc4eb4d49 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.220739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.221629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.222085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.222561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.223406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:39.223879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.225446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.234383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 317/619] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:39.239873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.257157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.302818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2d78-8eb8-4871-a516-e6e59709f66f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.343126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49169282-b7da-4f19-9a56-73b4422c1e81 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.354459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.354857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.355135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.355407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.379032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.379589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.380435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.380542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.381100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.381548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.392985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.394700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:39.408879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:39.409864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:39.410775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:39.410775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:39.410775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:39.411793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:39.412712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:39.413624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:39.413624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:39.413624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:39.414714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 303/620] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:39.415843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 318/621] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:39.420702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.422210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.489823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.500935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.553189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8abac-416b-40ca-86db-dfdc0b5288cf None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.595218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.599202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.611503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 319/622] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:39.616771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.623982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860bc5-d7ab-44a0-94a8-ed7a0450faeb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.685896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.686520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.686801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.687071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.687728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:39.688029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.689439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.707497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 304/623] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:39.708885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.742176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f857-a74f-4406-8838-441a514fa4ab None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.799608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.814045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.814674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.820799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.820799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.826053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.828066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.853742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a2bf9a96-5535-4818-8c1d-906c2449b175 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:39.855102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:39.856328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:39.857681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:39.863893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6012-74a6-49ab-98dd-4e3ad26065f2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:39.864340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 320/624] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:39.865946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a11ad-8d03-4bc5-b93d-9e30fce3b35e None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.872511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a11ad-8d03-4bc5-b93d-9e30fce3b35e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.872511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a11ad-8d03-4bc5-b93d-9e30fce3b35e None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.872511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 321/625] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:39.873157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a11ad-8d03-4bc5-b93d-9e30fce3b35e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:39.899247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:39.899878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.900153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.900424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.907479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:39.908952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c8a3f5b6-3b26-4207-9ef5-1a14ee2e125a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:39.921014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:39.922124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:39.923266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:39.926807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 305/626] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:39.928033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:39.928316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:39.928614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:39.951592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:39.953343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:40.008558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a11ad-8d03-4bc5-b93d-9e30fce3b35e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.036613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 306/627] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:40.036613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.070923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.071707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.072080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.072445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.073935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:40.074742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.076723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.111984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 322/628] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:40.119264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.174942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.180044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.191312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97bcd-c7d6-4662-891c-8f9b66ae4877 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.228172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.228960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.229239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.229506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.230802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:40.231234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.233728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f6940-eb65-44d1-b379-5bc1988edbd7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.235450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a446d01-0def-43dc-b7fa-84c694941c10 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.248753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 307/629] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:40.250107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b82af-5051-4849-8600-1071a0d1d7ba None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.252707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b82af-5051-4849-8600-1071a0d1d7ba None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.252707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b82af-5051-4849-8600-1071a0d1d7ba None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.252707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 308/630] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:40.255032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b82af-5051-4849-8600-1071a0d1d7ba None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.290769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.291766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.292348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.292648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.370565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b82af-5051-4849-8600-1071a0d1d7ba None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.374850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.376325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848c7cf-08e9-415b-9211-6b48b0d5315a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.407635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.408633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.409126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.409408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/38ca2939be224113a823b0bbba092f0c/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.423936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.425564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=38ca2939be224113a823b0bbba092f0c, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.427145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.429331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.480634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 323/631] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:40.482176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.482727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.500303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:40.501490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:40.529337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 309/632] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:40 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/38ca2939be224113a823b0bbba092f0c/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:34:40.530488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.600860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 324/633] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:40.602249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.669375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f45b-abd4-4cf9-9152-31739d24323d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.714552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.715536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.715823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.716248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.727513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-b797869f-4eb3-4045-bf7d-1ac145452b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:40.732564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:40.733706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:40.734774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:40.735536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 310/634] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:40.736519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971406-665d-4b1a-8a87-12ba97125409 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.736817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971406-665d-4b1a-8a87-12ba97125409 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.737084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971406-665d-4b1a-8a87-12ba97125409 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.738542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 311/635] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:40.742108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.742235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53971406-665d-4b1a-8a87-12ba97125409 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.772864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae378a5-29d1-4301-b6d0-0adc9d85f4e0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.812020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.813098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.813632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.814118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.818238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:40.827005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.830750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f626587a-6445-46ba-b724-6ac456b2c9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:40.846119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:40.847117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:40.848044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:40.848044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:40.848044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:40.851655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 325/636] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:40.857683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.858199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.858637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.872965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53971406-665d-4b1a-8a87-12ba97125409 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:40.878703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:40.880142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:40.916913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:40.917698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:40.917887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:40.918160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:40.919782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:40.920303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:40.922536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:40.931486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 312/637] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:40.932425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:40.969040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 326/638] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:40.970004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.039585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.070773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6279196-4fc1-4814-8af0-d14a3c211e3c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.091022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87992bf4-c00f-48f0-9134-010dfc0a5473 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.095496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.120637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.121829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.122352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.122977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.124157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:41.124572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.126601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.132433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.133442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.133888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.134301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.146291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 313/639] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:41.146291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.151992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:41.158049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:41.159192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:41.160327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:41.162460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 327/640] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:41.163459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.261066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1457d-6907-454e-b670-29ca917f44b6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.273141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcb056-68cd-4e07-b398-df78ede7ea1b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.290765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.298409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.299046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.299323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.299594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.311518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.313047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.315808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.316457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.316804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.317071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.323599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.325681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:41.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:41.330514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:41.331998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:41.331998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:41.331998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:41.331998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 314/641] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:41.331998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:41.342978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:41.344144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:41.345095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 328/642] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:41.345624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.366772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.448563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54390-921c-4140-9770-3e4c75de7a71 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.450107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f21c-b000-4a03-9137-14b6944d39d9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.486259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.486867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.487144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.487260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.487467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.487890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.488070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:41.488166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.488368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.488473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.489770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.502517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 315/643] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:41.502517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.504218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:41.509854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:41.510815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:41.511717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:41.516372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 329/644] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:41.517322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.556365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.598434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.609247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8063d1-e64d-4a4a-b84f-d57e6dacffb5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.629072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250e8f-a46f-4161-a4e5-a23ef258d05d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.645965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.646584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.646863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.647134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.647780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:41.648079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.649577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.661484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 316/645] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:41.662629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.672060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.672697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.673049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.673321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.674014 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:41.674307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.675752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.688521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 330/646] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:41.689389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.782860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b90c-c129-4682-a445-4cbee39b126e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.790860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.798275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebc73-5c87-4f44-8d3c-2a097367c2a9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.818577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.819498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.819977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.820463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.834303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:41.834815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.834927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:41.835177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:41.835446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:41.836108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:41.836284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.836441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:41.837905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:41.846178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 331/647] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:41.851613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:41.852433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:41.853379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:41.854301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:41.854301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:41.854301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:41.858794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 317/648] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:41.859414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:41.862155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:41.963715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae251-114e-4ade-a417-268e64b833ff None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:41.970683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3966e9-d80a-411b-9e98-008496e47d36 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.002913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.004003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.004838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.005574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] PATH_INFO: `/v3/users/glance` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.009158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.009789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.010068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.010341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.011070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:42.011378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.013400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.015306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.017695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.019232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 318/649] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:42.020022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:42.044989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:42.046005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:34:42.046986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:42.054765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 332/650] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:42.054765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.087941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.110386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.170291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691278-ea9f-4399-aeca-0d1673b93fb3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.194798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bf18-18b3-4d2d-bcaf-94d3f6c5007d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.225200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.225991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.226278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.226554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.239630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.240568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.240729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.241211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.241688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.242146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.242774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:42.243281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.244923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:42.260427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:42.261529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:42.263242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:42.263242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:42.263242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:42.263421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 333/651] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:42.265014 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.265796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 319/652] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:42.270110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.364187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.390282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc491-1efb-4a1d-a6f2-02a17f191094 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.397284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f951c98-14b7-437b-9484-ac6bbc5bcdd7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.419777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.432764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.433640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.434570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.435578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.436453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:42.436965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.438535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.442742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.443564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.444012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.444433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.455334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.457184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.461844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 334/653] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:42.462837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:42.473062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:42.474258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:34:42.475266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:42.478641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 320/654] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:42.479802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.578751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4fe8-4313-4b3d-858a-d1375d88bf30 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.607078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c938-d6e3-4b40-aa85-ea91ff899596 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.615553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.616094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.616372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.616671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.617318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:42.617617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.618999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.623193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.632453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 335/655] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:42.633406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.648157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.649101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.649566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.649984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.700480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.723205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.724716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.738742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e813a56-1edf-4cfe-aa9e-2cc0377cfc69 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.778138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.778747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.779018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.779283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.780001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:42.780298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.781769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0da726-d49a-4e34-8872-946491ef7dc6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 336/656] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a650-5cca-4862-954c-7e4fce58860b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a650-5cca-4862-954c-7e4fce58860b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366a650-5cca-4862-954c-7e4fce58860b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 337/657] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:42.805788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366a650-5cca-4862-954c-7e4fce58860b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.841793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 321/658] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:42.841793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:42.871924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.916779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366a650-5cca-4862-954c-7e4fce58860b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.920014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:42.942996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9858-44f6-4737-8e07-fa39063d98ef None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:42.961861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.962780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.963056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.963322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.972690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:42.974156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:42.980108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:42.981348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.981626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.981894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0663d3d4-9804-4f65-9749-c74645b9b0d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:42.987391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:42.988330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 338/659] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:42.994265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:42.995055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.010352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:43.011553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:43.060914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.062626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.078424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 339/660] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:43.089499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.141623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.155992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.184458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 322/661] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:43.184458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.204547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43263a25-f970-4180-848f-e3f2c693e8ee None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.242797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.243930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.244458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.244976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.256756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.258541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:43.276694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:43.278291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:43.279237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:43.279237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:43.279237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:43.284987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 340/662] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:43.286080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.294147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93b00-9ccc-4eff-ba72-d1bc174306c8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.331646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.332311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.332614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.332899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.333999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:43.334110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.335656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.355307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 323/663] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:43.356972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.391213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.393446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.400527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be8408-ade9-4f14-be4f-d0bb7f0d3eee None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.435869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.436607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.436904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.437171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.447960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.449514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.460009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039d64d-9b5a-48f6-84f4-7fe1cc70c94c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:43.465438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:43.466416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:43.467329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:43.467329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:43.467329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:43.471170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 341/664] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:43.471802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.497958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.498671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.499023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.499368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.500076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:43.500381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.501796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.513988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 324/665] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:43.514823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.583516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b7f5d-3889-4dbd-9455-cac3ccc0a464 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.617282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.624101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a2808-2771-4e1e-843b-63eb98ed4bb2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.625083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.625711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.625986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.630537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.636707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:43.642926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:43.643924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 342/666] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:43.645362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.657774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.664044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.664679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.664957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.670669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.736866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.738313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.754876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def431b5-e874-416a-bff5-a3703c50f299 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.789520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.790130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.790406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.790673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.791316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:43.791611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.793020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.809983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 343/667] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:43.809983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.841784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.848746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 325/668] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:43.849712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:43.878310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:43.915134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2aa8-ea27-4cfe-bad1-f97e151e4403 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.951890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:43.952914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:43.953396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:43.953889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:43.961145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:43.962601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:43.969025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279566-275b-4cc6-8f41-b60a863c9db8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:43.973672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:43.974575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:43.976079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 344/669] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:43.980056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.006276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.007055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.007664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.007948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.008638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.008946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.010475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.018803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 326/670] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.019599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.083340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.093761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357afec-93a5-43b6-8eb8-f39fa287a4d8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.122066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.127512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc155-b50d-44b9-8d6e-e4037ac78c6b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.131769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.132546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.132898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.133169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.140264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.141768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:44.152997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:44.154062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:44.155171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:44.157168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 345/671] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:44.158364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.164302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.165008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.165336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.165555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.176896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.178305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:44.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:44.194994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:44.195968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:44.195968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:44.195968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:44.195968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 327/672] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:44.195968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.267086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a1c8-8518-4881-b350-3a7ab182acd2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.297373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556884a-c0d7-4aa9-9ebe-19ef50139192 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.299928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.300527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.300828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.301095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.301775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.302074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.303497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c014-e854-41d0-bee8-05a4d08ee263 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.307967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.315330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 346/673] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.316493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d6a5-0e59-44d9-a056-49c00be80bdd None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.316790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d6a5-0e59-44d9-a056-49c00be80bdd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.317061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4d6a5-0e59-44d9-a056-49c00be80bdd None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.318521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 347/674] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:44.319222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4d6a5-0e59-44d9-a056-49c00be80bdd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.333297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.333939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.334207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.334475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.345502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.346930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:44.362340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:44.363451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:44.364527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:44.364527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:44.364527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:44.364527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 328/675] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:44.364527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.375417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.425925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4d6a5-0e59-44d9-a056-49c00be80bdd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.459501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.460100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.460373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.460668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.461355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.461651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.462958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843abe5b-9bfb-4254-8e56-112cf55f9374 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.463064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.475725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 348/676] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.476527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.503441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.504049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.504328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.504610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.505272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.505565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.506923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6ebf-0101-4468-9ef4-bf069cb68a2d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.519772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 329/677] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.520987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.521269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.521542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.538850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:44.540182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:44.557137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.581227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ef80-5bda-46f1-82e1-c57a352f7517 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.590411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.608581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 330/678] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:44.609488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.614391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.614990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.615316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.615587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.616299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=b0c38e0197d54850803f0cf9a3419dbc) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.616613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.618090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.624352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 349/679] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/role_assignments?user.id=b0c38e0197d54850803f0cf9a3419dbc&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.625345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.741107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62129-fabc-448d-8010-27c9c3ee4f6b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.779813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51111-9893-462d-a86c-98a1a8bee2e7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.791587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.792205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.792482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.792834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.794879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.794879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.796169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.810911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 331/680] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.812534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.831425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.832271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:44.833184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:44.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:44.834032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:44.834916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=e7dce5cc34ce4930ade1d9ba9e3bddd2) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:44.835374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:44.837022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:44.848709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 350/681] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/role_assignments?user.id=e7dce5cc34ce4930ade1d9ba9e3bddd2&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:44.848709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:44.891869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:44.961446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ae41-d779-471c-8685-d641881aba0c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:44.995139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e7a62-0b43-428b-b467-bc406b04ded5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.014825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.015632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.016012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.016737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.027996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.031298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.035498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.036315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.036686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.036900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:45.044694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:45.045652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:45.046608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:45.047053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.047053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.047263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 332/682] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:45.048344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:45.061756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:45.063019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:45.064196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 351/683] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:45.065032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.134368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.164946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120252-b757-423b-8f5b-e22d76f67a05 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.185012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.194982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b553-4891-45a9-9049-80a85e5c92e7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.206916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.207548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.207821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.208148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.219052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:45.224772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:45.225944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:45.226995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:45.230772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 333/684] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:45.231598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.241397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.242247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.243073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.243564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.244940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:45.245555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.247935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.266067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 352/685] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:45.267136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.351318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da189-00d0-45d2-8a66-b549add275c7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.386166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdb56-cda7-4a3b-bddc-3fa6fc3ede31 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.391008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.396526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.397339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.397813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.398243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.399131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:45.399577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.401367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.422647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 334/686] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:45.423854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.424134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.424857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.425205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.425546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.426281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:45.426965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.428105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.442155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 353/687] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:45.443359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.464556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.541590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd31ac-fc76-49f5-b9dd-8c3c324a9db2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.550544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30be5a-bf65-4a55-b8b4-37c9c3a6f5af None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.580609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.581558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.582024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.582547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.583451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=80d508c497124391ad6e0ff77a534b0d) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:45.583951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.586001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.587304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.587979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.588370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.588695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.593805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 335/688] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/role_assignments?user.id=80d508c497124391ad6e0ff77a534b0d&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:45.594807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.660916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.680117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.685806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.711025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3535160-e1be-43ec-9355-11c555db2dd9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.720645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.756002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.757061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.757525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.758117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.776212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.788178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:45.809674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:45.810668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:45.811603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:45.811603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:45.811603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:45.814242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 336/689] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:45.820787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.876235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 354/690] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:45.881455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:45.953354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5e6a1-14fc-4d06-ab6d-b7bca4e03557 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.973002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:45.994388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:45.995256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:45.995677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:45.996091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:45.997236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00666-9795-44a0-888b-a619fb4270d0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:45.997584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:45.998039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:45.999774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.014038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 337/691] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:46.019894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.021606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.035395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.036168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.036382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.036751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.049217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.050948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:46.068111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:46.069198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:46.070108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:46.070108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:46.070108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:46.070108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 355/692] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:46.079838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.182087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235557c5-885a-44c5-af17-77a682e27340 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:46.218245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.218884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.219163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.219432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.227102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.228548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:46.241940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:46.242927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:46.243917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:46.248303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 338/693] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:46.249558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.278620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869cb4d2-bd17-4b42-be16-d953743ef129 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:46.299232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.351030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.351610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.351893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.352165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.352835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:46.353136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.354516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.356385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68225-2a9d-4a94-836e-92b454121059 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:46.382896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 356/694] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:46.388195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.393082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.393777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.394129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.394477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.395327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:46.395708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.397354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.420722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 339/695] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:46.422858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.444974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.517155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.533156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2759f-d7f9-4c8a-ba27-38ff1cf4d060 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:46.569522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.570269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.570696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.571038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.631092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1be00-f51b-4ac1-9405-b13d98da286e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:46.688757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.690914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.699906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:46.703531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:46.703814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:46.704083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:46.719916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:46.721418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:46.734444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:46.735398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:46.736301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 357/696] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:46.741008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.875682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.907659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 340/697] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:46.909188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:46.915154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:46.937705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcc5c0-c72c-4154-b4ac-9557eea587b9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.022467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.023370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.023789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.024199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.025062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:47.025514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.027078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6eba-778f-46f9-985b-f9cad16c77ff None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.039675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6a0b8-e2b3-4c40-bede-812c87a6a0a5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.054359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 358/698] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:47.055826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eec0-5b8d-41ca-843d-dc217d5f1842 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.056255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eec0-5b8d-41ca-843d-dc217d5f1842 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.056716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500eec0-5b8d-41ca-843d-dc217d5f1842 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.058275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 359/699] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:47.063813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290ae2-83ac-4a84-9c47-c1a5eb56928d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.064261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290ae2-83ac-4a84-9c47-c1a5eb56928d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.064704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290ae2-83ac-4a84-9c47-c1a5eb56928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.084658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7b290ae2-83ac-4a84-9c47-c1a5eb56928d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:47.085849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7b290ae2-83ac-4a84-9c47-c1a5eb56928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:47.086973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.088052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.088566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.090005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.102854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.104695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:47.120666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:47.121907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:47.123000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:47.123000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:47.123000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:47.124381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 341/700] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:47.125315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.157458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 360/701] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:47.164807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.166354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618eeb-533c-43bc-8ee4-3e29e53941f0 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.166825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618eeb-533c-43bc-8ee4-3e29e53941f0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.167277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5618eeb-533c-43bc-8ee4-3e29e53941f0 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.169002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 361/702] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:47.169921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5618eeb-533c-43bc-8ee4-3e29e53941f0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.241877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2cf56-9bdb-4b5a-a833-84906d92e448 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.261112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.280263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.281033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.281356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.281714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.282603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=38ca2939be224113a823b0bbba092f0c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:47.282974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.283440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5618eeb-533c-43bc-8ee4-3e29e53941f0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.284519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec71a7-699c-4ba8-bdc8-b3ec15ee3e8a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.290945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 342/703] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/role_assignments?user.id=38ca2939be224113a823b0bbba092f0c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:47.292353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.292720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.293098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.314454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:47.315801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:47.323644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.325498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.326010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.326766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.327685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:47.328215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.329870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.342565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 362/704] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:47.357156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.409025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 343/705] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:47.494475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2908eb-7ba7-4f87-ab50-c1cba38c79e3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.522988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.547152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.547931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.548206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.548472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.559457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.561358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.564829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.565648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:47.579397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:47.582774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:47.583690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 363/706] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:47.586904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.651071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849246-2bbf-40e6-9d45-9a5648deb1a5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.695751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.696928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.697440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.698022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.700133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.702185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:47.715706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:47.716836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:47.717755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:47.718537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 344/707] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:47.719205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.723856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e70b9-f24e-4ae6-842d-026941e885ff None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.767715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.768258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.768534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.768898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.769595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:47.769911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.771408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.788038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 364/708] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:47.789087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.836833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.844270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0ef-89c1-497c-a5c1-61a68dc3346a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.858884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:47.879926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.880626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.880914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.881183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.893141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.894593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.898783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53f224-2bb9-4690-aac6-0fdcb70e4631 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:47.910065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:47.911093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:47.912011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:47.912011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:47.912011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:47.912011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 345/709] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:47.912250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:47.942005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:47.942710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:47.942997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:47.943269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:47.944008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:47.944312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:47.945825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:47.960039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 365/710] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:47.961323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:48.031533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf94a89-0975-4f91-ae04-9f74f3ca91d5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:48.071766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:48.072555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.072796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.073046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.073886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:48.074922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:48.076242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:48.077425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a85bd-800e-44c9-ad4c-25ad9e519ab0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:48.092966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 346/711] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:48.092966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:48.106985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:48.115463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:48.129188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:48.129986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.130369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.130764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.131528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:48.131936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:48.133534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdda66f-d947-4ca0-a88e-b341871f4ec7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:48.148159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 366/712] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:48.149758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aef5a-1e54-4667-bd69-70e200e59125 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.151616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aef5a-1e54-4667-bd69-70e200e59125 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.152501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aef5a-1e54-4667-bd69-70e200e59125 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.155257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 367/713] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:48.156545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aef5a-1e54-4667-bd69-70e200e59125 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:48.220760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678db3c-bc21-46b6-8432-f3a5aba3a60a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:48.263023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:48.263644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.263921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.264207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.266715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:48.267147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:48.268664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7df51-8aba-4a5f-880a-877a4a453479 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:48.275204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 347/714] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:48.276375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.276824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.277258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.297951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:48.298447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aef5a-1e54-4667-bd69-70e200e59125 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:48.299463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:48.347363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:48.348238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.348715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.349720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.350528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:48.352625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:48.387852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 348/715] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:48.468095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 368/716] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:34:48 2022] POST /identity/v3/users => generated 254 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:48.672876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:48.676115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:48.781804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf03850-42d1-49ac-abc0-a55d6dc7508a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:48.818558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:48.819560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:48.820075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:48.820552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] PATH_INFO: `/v3/services/network` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:48.821371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:48.822975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:48.832566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:48.833613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:48.834493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:48.840697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 349/717] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:48 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:48.843819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:48.890120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:48.964044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1a8d7-6c69-477b-bb0d-831a3dedad11 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:49.000841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:49.001886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:49.002425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:49.002900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:49.003738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] RBAC: Adding query filter params (name=network) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:49.004243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:49.005941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f8f3-31a9-4738-b290-5d7cbbf3429a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:49.015336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 369/718] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:34:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:49.017070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:49.101012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:49.146112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9ecd1-bdb7-41f0-b8f0-a892b609a66b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:49.185495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:49.186118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:49.186400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:49.186677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:49.187321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] RBAC: Adding query filter params (type=network) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:49.187627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:49.189014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7bb49-c10f-4117-9dd2-a33b2c20ce94 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:49.194073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 350/719] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:34:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:49.645567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538820-1373-4663-ada7-2fde7a09202d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:49.645821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538820-1373-4663-ada7-2fde7a09202d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:49.646091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05538820-1373-4663-ada7-2fde7a09202d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:49.647582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 370/720] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:49.653161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:49.653762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:49.654237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:49.673063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:49.674612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:49.761503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 351/721] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:50.127289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538820-1373-4663-ada7-2fde7a09202d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.262391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05538820-1373-4663-ada7-2fde7a09202d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:50.264770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:50.312096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:50.312761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.313036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.313303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.329817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-9690448d-3d3c-403f-ac43-f5cfa2161db6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:50.334574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:50.335517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:50.336378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 371/722] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:50.343831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.403402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213323-d3de-4ecf-8fd1-d08909c6174e None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.403721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213323-d3de-4ecf-8fd1-d08909c6174e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.403989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4213323-d3de-4ecf-8fd1-d08909c6174e None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.405590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 372/723] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:34:50.411575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.411869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.412142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.433133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:50.435077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:50.435702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:50.504207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b835d-4e25-4c26-932b-85358f34b5a8 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:50.564348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 373/724] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:50.569221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:50.570747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.570747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.570747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.571217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:50.571571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:50.572962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:50.583246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 352/725] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:50.593729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.696945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:50.708889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa333-f12b-4b15-8a71-7da60a4c8f95 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:50.760177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:50.760846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.761121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.761389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.772750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:50.774205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:50.793442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:50.794419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:50.795339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:50.795339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:50.795339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:50.795339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 374/726] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:50.801770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.859821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.968494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69883b-931a-4309-b038-de8f68eb18a8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:50.996852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.009090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.010031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.010460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.010919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.011835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:51.012338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.012772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b057-414f-4167-98f7-abce8c41f799 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.014273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0362-c2f3-4492-9bb9-7b9522c660ad None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.027776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 353/727] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:51.029288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370e1f-7f4f-45f5-b39b-60438e3a6ec9 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.029808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370e1f-7f4f-45f5-b39b-60438e3a6ec9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.030292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370e1f-7f4f-45f5-b39b-60438e3a6ec9 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.035697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 354/728] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:51.037515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.038005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.038462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.055552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.056444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.056444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.056771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.063863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:51.065451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.067725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:51.073094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:51.074783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 375/729] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:51.075869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.089007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.142919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 355/730] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:34:51.145513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.182384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6a221-b18c-45cc-af50-bb8af211a7ff None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.217377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.218291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.218729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.219146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.227059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.228834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-3dc2f80c-79ff-4cc3-ac41-8b4256612138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:51.241355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:51.242384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:51.243387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:51.246521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 376/731] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:51.248146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f592-4a36-429d-a88d-cc2a015b10fe None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.248651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f592-4a36-429d-a88d-cc2a015b10fe None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.249115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f592-4a36-429d-a88d-cc2a015b10fe None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.254756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 377/732] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:51.256100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.256387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.256694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.275574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2cfce-3f07-425d-b61f-0c0ef6c93781 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.276727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:51.277945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.295742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.318802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.319897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.320401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.321170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.322036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:51.322695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.325665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.342060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 356/733] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:51.342060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.360948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.366976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 378/734] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:51.368064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.493616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851fb8a-4c7e-4aa5-af0d-e2cab82e9e3e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.507927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81a448-e3b4-4237-855c-d417f3afd09a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.535450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.536385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.536980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.537494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.538465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:51.538964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.540775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.546577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.547265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.547549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.547821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.559427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.560725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.568211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 357/735] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:51.569456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:51.577722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:51.578724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:51.579623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:51.579623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:51.579623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:51.583544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 379/736] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:51.584579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.611549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.635182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.685402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13524f28-2a01-46bc-8340-5717097eb158 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.688527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959140-c92e-4e20-a2d3-8aa5fafb8c6a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.726628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.727233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.727508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.727776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.728415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.729796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.731306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.731916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.732197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.732471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.805217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.806584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.835209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 358/737] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:51.836116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.867069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.926567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 380/738] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:34:51.927948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.959429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.978988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9871aa-ae4f-458c-bda5-1408b147f642 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.019270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.019887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.020167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.020438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.022530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:52.022530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.023200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927cacf-7b2b-4fb9-be62-7d4db8d43003 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.034689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 359/739] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:52.035993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619e7a-02a4-4cc0-bd0e-ae2497b4bba5 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.036484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619e7a-02a4-4cc0-bd0e-ae2497b4bba5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.036970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a619e7a-02a4-4cc0-bd0e-ae2497b4bba5 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.038636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 360/740] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:52.039476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a619e7a-02a4-4cc0-bd0e-ae2497b4bba5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.059385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab3f60-f422-4248-ab09-29c9d349fa00 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.103102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.104037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.104533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.104840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.115434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:52.120227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:52.121935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 381/741] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:52.122807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.135845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.152624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a619e7a-02a4-4cc0-bd0e-ae2497b4bba5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.189024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.189655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.189933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.190205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.202854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.204296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-b835fadc-8ce5-4035-8be1-9233ce19d01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:52.220038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:52.221049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:52.221998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:52.221998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:52.221998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:52.221998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 361/742] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:52.222660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.222660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.222912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.229814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.235250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a963-11fc-461f-8423-740f317d35bf None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.242344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:52.243537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.271810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.272449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.272828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.273100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.280885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.282356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:52.294198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:52.295177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:52.296189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 382/743] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:52.296841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.324622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 362/744] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:34:52.325239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.387218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.425035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf9de2-c07e-4adf-9092-91d19f33322f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.441635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87338f0c-c1e1-4e1b-bf3a-3070e7444c03 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.461911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.462806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.463265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.463737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.464651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:52.465181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.467280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.476189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 383/745] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:52.477339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.479418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.485720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.486340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.486618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.486888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.487537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:52.487835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.489691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.508649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 363/746] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:52.508649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.611217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cd049-dbc1-4b40-b4c9-4bc0097f7670 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.620621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319e29-caf6-4456-b731-9099da017eee None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.643693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.649147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.649753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.650032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.650308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.651071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:52.651376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.652874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.658171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.658171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.658171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.658171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.667749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.669285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.670169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 384/747] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:52.673484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:52.684645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:52.685686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:52.686615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:52.686615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:52.686615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:52.688926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 364/748] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:52.689732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.740965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.794135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebcee1-ab3f-4eca-88d3-15cef2db5ee2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.798180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52922907-f737-486c-95da-e4d0a8593e60 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.831699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.832326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.832623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.832917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.835319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.835925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.836199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.836466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.837137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.838480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.840196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.841707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:52.852917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:52.853823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:52.854757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 385/749] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:52.855460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.904835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.911592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 365/750] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:34:52 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:52.917424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.976500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef328a79-9d83-4438-80dd-3c497f023e6c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.023701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.024443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.024845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.025186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.037638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.039331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:53.055822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:53.056902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:53.057844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:53.057844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:53.057844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:53.062834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 386/751] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:53.063732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.071470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e8c-2855-494b-9fdd-4e2f35c755c5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.074335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.112221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.112882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.113210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.113486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.114133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:53.114482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.115854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.130947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 366/752] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:53.131785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.176619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.184833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2877d-5a0c-4824-b67d-e7291c636ab6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.237242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.238038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.238531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.238804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.239900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:53.240204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.241807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.255844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211ead5-1662-405e-8b58-8c4c33de3f77 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.259377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 387/753] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:53.260238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.298630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.299424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.299795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.300163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.300994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:53.301392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.302879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.321167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 367/754] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:53.322430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.356850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.389470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a53b0-65c3-43aa-b3f1-f5559f0418ea None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.424940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.425573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.425902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.426173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.434887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.436274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.447587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02cf51-e5aa-4f64-8675-59a11e213f68 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:53.448164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:53.449918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:34:53.450920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:53.455269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 388/755] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:53.456116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.475305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.488880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.489494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.489773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.490042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.490771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=38ca2939be224113a823b0bbba092f0c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:53.491076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.492500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.499733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 368/756] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/role_assignments?user.id=38ca2939be224113a823b0bbba092f0c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:53.500622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.569772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df3bb-f76a-41fe-a1e1-285368bd27f7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.622427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.623433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.624526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.625164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.639533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.642684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:53.663272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:53.664281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:53.665225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:53.674169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 389/757] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:53.682563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.710491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.733293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9448-9705-4f32-84ec-5795c21a2611 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.815415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.816050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.816330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.816618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.817389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:53.817691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.819182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041159f-e459-46ef-ac75-68652d256f93 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.845448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 369/758] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:53.846771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5528-01ed-4a3c-8e00-78bb32dbf8da None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.847062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5528-01ed-4a3c-8e00-78bb32dbf8da None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.847344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5528-01ed-4a3c-8e00-78bb32dbf8da None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.848927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 370/759] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:53.853919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5528-01ed-4a3c-8e00-78bb32dbf8da None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.938610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.977251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efcc0d-bf07-4c35-80f6-feacf8a750ac None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.977496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5528-01ed-4a3c-8e00-78bb32dbf8da None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.015722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.016684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.016967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.017234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.017955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:54.018219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.019771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ee719-a844-4bb7-a8b1-38d1552c4217 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.021704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.022626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.023084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.023533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.033594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 390/760] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:54.037189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.037894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.038344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.044816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.058805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:54.060690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:54.113356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.115930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.138512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 391/761] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:54.139621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.258645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.295532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 371/762] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:34:54.300722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.319311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303d95f-d53b-44bb-8ea9-73082bac55a9 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.379521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.380175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.380451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.380740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.384800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.385148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=a69da51c538a4e29ac81a774c36c4931, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.387212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.444405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319d5db-be43-47ad-830a-3d6f02414d50 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.471722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 392/763] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:54 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:54.476179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.483761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.484471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.484781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.485052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.497506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.499020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:54.516528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:54.517787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:54.518725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:54.518725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:54.518725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:54.518725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 372/764] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:54.523479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.671095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d52694-6472-45e8-b9e9-94da997c50c4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.702821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.710798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.715997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293a03e-a729-46ff-b934-8ce3feaa7937 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.719449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.719449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.719449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.719449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.719769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.720342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:54.732103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:54.733435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:54.734442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:54.736817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 393/765] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:54.745413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.762039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.764096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.764096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.764096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.764552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:54.765212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.766357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.780457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 373/766] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:54.786083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.854426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d34c4-6ba9-49a7-801d-fa535c494693 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:54.892226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:54.893138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:54.893556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:54.893967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:54.894783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:54.895226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:54.896823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:54.901948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 394/767] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:54.907642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:54.966550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:54.976170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af9152-a25c-44f3-931c-82a8155eced9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.012499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893027c6-48ab-43d4-a971-ab73b4c5fd2e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.038386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.038955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.039284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.039493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.047727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.049415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:55.062571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:55.063532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:55.064459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 374/768] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:55.069616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:55.089972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.090551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.090832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.091103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.091741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:55.092039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.093460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.095796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:55.110702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 395/769] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:55.116654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:55.183439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f590404-a749-4a38-90a2-fbf1c75e38fb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.225966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.226606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.227271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.227554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.228257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:55.228575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.230959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.244981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 375/770] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:55.252180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:55.347998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:55.363923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3ada-08dc-4aae-9b6a-c5b0d9b15665 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.374413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43b8e-2f2d-45b8-9fd4-d08284a972ea None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.387233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:55.405038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.405552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.405931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.406301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.407105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] RBAC: Adding query filter params (interface=public, service_id=d715b0018ff4443793736d125e103f09, region_id=RegionOne) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:55.407512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.409062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2ae2-f110-4204-99af-81ce44c60dae None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.413800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.414584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.415005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.415422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.416287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=4b0dcea4fe9f4743900680142e94e505) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:55.416804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.418551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 396/771] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:34:55 2022] GET /identity/v3/endpoints?service_id=d715b0018ff4443793736d125e103f09&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:55.419464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0b0ba-1d68-44da-ba22-c8a77bc7cbc6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.420167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6f1b-81e1-40c6-bd82-1e1354f0fc70 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.420547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6f1b-81e1-40c6-bd82-1e1354f0fc70 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.420941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6f1b-81e1-40c6-bd82-1e1354f0fc70 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.422793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 397/772] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:55.423688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6f1b-81e1-40c6-bd82-1e1354f0fc70 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:55.426709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 376/773] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:34:55 2022] GET /identity/v3/role_assignments?user.id=4b0dcea4fe9f4743900680142e94e505&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:55.428064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b502-fe52-4b27-8d99-5344a3180b20 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.428503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b502-fe52-4b27-8d99-5344a3180b20 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.428954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b502-fe52-4b27-8d99-5344a3180b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.461683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7356b502-fe52-4b27-8d99-5344a3180b20 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:55.464114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7356b502-fe52-4b27-8d99-5344a3180b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:55.547734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 377/774] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:55.609755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6f1b-81e1-40c6-bd82-1e1354f0fc70 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:55.663343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1db965-0631-4343-af85-66732e32897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:55.664195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1db965-0631-4343-af85-66732e32897b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.664638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1db965-0631-4343-af85-66732e32897b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.665049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1db965-0631-4343-af85-66732e32897b None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.665819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1db965-0631-4343-af85-66732e32897b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:55.667320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1db965-0631-4343-af85-66732e32897b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:55.671524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e193-39ed-4b3a-a3b8-ec11bbc3c9f6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.671821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e193-39ed-4b3a-a3b8-ec11bbc3c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.672100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1e193-39ed-4b3a-a3b8-ec11bbc3c9f6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.674713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 378/775] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:34:55.677108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 398/776] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:34:55 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:55.678845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:55.679132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:55.679405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:55.717780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:55.719019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:55.810590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 379/777] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:55.938466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1db965-0631-4343-af85-66732e32897b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:55.991805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.051570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1db965-0631-4343-af85-66732e32897b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.095697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.096451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.096758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.097028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] PATH_INFO: `/v3/services/network` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.097613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.098975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:56.112665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:56.113676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:56.114514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 399/778] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:55 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:56.122249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.125139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.128953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.238894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007bbd6-2fc7-4786-86b8-e9ba8ab65f8d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.298100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.298864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.299142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.299417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.300065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] RBAC: Adding query filter params (name=network) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:56.300365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.301768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.315812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 380/779] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:56.321083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.349741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c896d0-dc2b-47c9-a2d7-c1b27d6cab56 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.368973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.417159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.417909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.418188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.418566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.438306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:56.445108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:56.446045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:56.446920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:56.447565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 400/780] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:56.453055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.457993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.530691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc34d-a631-4e46-873f-49082986be7f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.571207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290cec-f98c-4409-836d-5ac7a2d62aac None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.610592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.611569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.612044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.612543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.613429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:56.613881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.614168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.614496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.614773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.615046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.615681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] RBAC: Adding query filter params (type=network) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:56.615977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.616801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.617339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.626522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 401/781] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:56.636626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.636785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 381/782] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:56.648550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.700982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.797111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c2eb-ca3f-4b50-951b-1f126bce05aa None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.848485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:56.849314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468db4-ffe2-44d8-b237-eaf78256bc22 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:56.864965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.865575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.865848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.866112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.866813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] RBAC: Adding query filter params (interface=public, service_id=1c9b7355237d427ca452f2f00df7a501, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:56.867855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.869244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.887376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 382/783] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/endpoints?service_id=1c9b7355237d427ca452f2f00df7a501&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:56.893029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:56.905609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:56.907138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.907669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.908138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.920511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:56.922196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-7ee65acb-a13a-4a4c-af28-b1ccdf328ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:56.939845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:56.940901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:56.942227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:56.942227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:56.942227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:56.942227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 402/784] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:56.942460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c18-7ab2-450b-be39-c7d19af49060 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.942715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c18-7ab2-450b-be39-c7d19af49060 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.942980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c18-7ab2-450b-be39-c7d19af49060 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.949208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 403/785] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:56.951025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:56.951559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:56.951838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:56.976688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:56.978320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:57.054096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe5205-1c91-4650-849b-7e1353194ac4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.067930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 404/786] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:57.069014 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.098213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.119660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.120269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.120542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.122901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.124860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.126878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.135405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 383/787] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:34:56 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:57.243631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909db2b-7f69-4356-b23e-7135ed367d4e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.290032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.290638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.290911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.291179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.291825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:57.292119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.293662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.306854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 405/788] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:57.312917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.375797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.407525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.422316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ae3a-14e5-4d7c-9860-aa369135658e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.459150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.459784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.460058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.460324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.469419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.470875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:57.482457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:57.483445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:57.484864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 384/789] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:57.489606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.500665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.529427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7fbc6-aa43-4f59-9d0a-d7acd9ba0492 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.567097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.568135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.568670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.569167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.581668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:57.587507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:57.588553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:34:57.590034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:57.596718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 406/790] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:57.598580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623185-978b-4992-b7ab-ab36a4316e1d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.599299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.617515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.635221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.636030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.636948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.637347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.638767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:57.638767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.640133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.659663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 385/791] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:57.665099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.710099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc846f-ce38-4e03-94da-c9810dbdf7a0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.746988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.747887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.748341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.748792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.749672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:57.750116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.751659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67461570-9f46-49fb-bda7-5e310987fd03 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.757744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.766769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 407/792] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:57.768373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c7d7-891e-4c4d-909b-4123008638b7 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.768921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c7d7-891e-4c4d-909b-4123008638b7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.769339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c7d7-891e-4c4d-909b-4123008638b7 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.771332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 408/793] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:57.772316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c7d7-891e-4c4d-909b-4123008638b7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.773617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422741a0-1656-4148-9017-05cc03a62c06 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.811837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.811837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.812559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.812559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.823196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.825919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-f8d6d21f-ab3a-478c-874c-c85ab6b518a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:57.841459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:57.842502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:57.843709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:57.843709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:57.843709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:57.847538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 386/794] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:34:57.849018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.849365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.850155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.870381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:57.872310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:57.888825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c7d7-891e-4c4d-909b-4123008638b7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:57.898704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:57.926631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:57.927603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:57.928191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:57.928672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:57.945320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:57.947055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:57.949998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 387/795] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:57.951180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:57.971421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:57.972470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:57.973438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:57.973438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:57.973438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:57.976712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 409/796] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:57.981946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.039256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.092622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d11a3-fc94-419b-a6b7-066182055fcd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.101103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d8ee-ac81-4c0d-9e39-80b6ca77cff4 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.128397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.129316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.129741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.130236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.131029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:58.131498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.133050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d5343-2858-433c-9afb-b84fa27b2cb6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.138027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.138639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.138914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.139188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.139836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:58.140135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.141519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.152270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 410/797] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:34:58.153933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba548-ed8f-4ea6-b926-9f15d5add1f0 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.154100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 388/798] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:58.154523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba548-ed8f-4ea6-b926-9f15d5add1f0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.155114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba548-ed8f-4ea6-b926-9f15d5add1f0 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.156013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.160420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 411/799] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:58.160420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ba548-ed8f-4ea6-b926-9f15d5add1f0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.189088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.276290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ba548-ed8f-4ea6-b926-9f15d5add1f0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.282037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4611-7334-4986-ae05-e87b751c2aff None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.286880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.313560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.314182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.314459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.314724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.316851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.317479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.317791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.318066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.322004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.323438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.325971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.327663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:34:58.335618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:58.336758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:34:58.337924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-bd517a78-ac2d-4347-a7cc-a9b2a77862bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:58.338850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:58.340311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:58.341462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 389/800] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:58.342161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.342161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.342315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.343561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 412/801] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:58.344517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.363495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:58.364711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:58.432460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 390/802] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:58.433395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.449706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.458083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bb61c-6fb8-4fcb-bd61-60528622bec4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.499397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.500032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.500310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.500578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.512010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:34:58.516960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:58.517899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:58.518772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 413/803] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:58.519479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.549814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.587289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60550-ffa8-47fa-a92e-b98a3ce96392 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.632267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611bc-7611-4573-a663-2acdcee82f7a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.675878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.676548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.676855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.677124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.677865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:58.678163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.679699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.702485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 414/804] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:58.703365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.752155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.752795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.753074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.753347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.754037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:58.754340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.755758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.773124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 391/805] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:58.773124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.800261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.816072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4eeb8-0b0f-49f6-865d-2a9b9d18e988 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.841136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:58.853459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.854070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.854349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.854617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.855477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:58.855870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.857274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:58.868172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 415/806] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:58.869737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:58.875875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a364e8-3029-4055-8b17-691178a45704 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.913575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:58.914177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:58.914450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:58.914718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:58.985314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ebfeb-0918-41db-a962-b75bb947c0a5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:58.987819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:58.989441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.024750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.025786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.025786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.025960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.026467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.028554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:59.037501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:59.038524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:59.039387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 416/807] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:59.040212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.057216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.064797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.101419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 392/808] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:34:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:34:59.102264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.149902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffea88-4a7f-4bbf-8939-01b0e0cb9dd6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.184967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.185560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.185829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.186100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/38ca2939be224113a823b0bbba092f0c/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.188052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=38ca2939be224113a823b0bbba092f0c, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.189520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.209194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8500ba-00e5-4c27-a487-54f2fa27aaf4 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.242365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.242991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.243267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.243538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.254532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.255963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.270976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 417/809] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:34:59 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/38ca2939be224113a823b0bbba092f0c/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:59.271254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:59.272125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:59.273061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:59.273061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:59.273061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:34:59.273061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 393/810] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:59.273297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.274276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.310037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.366804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.401128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7465005-4227-48a8-94fe-70b6e07da5ab None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.407700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770af17e-c47e-4a08-8a05-e9d0da71fb60 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.448212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.449035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.449273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.449441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.450850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.451716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.451987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.454133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.454133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:59.454133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.454547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.460884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 394/811] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:59.461962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.467377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.468465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-47c03ea2-157d-4fca-ba0d-3bac86c6aa20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:34:59.485323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:59.486332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:34:59.487403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:34:59.487403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:34:59.487403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:59.487403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 418/812] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:59.488759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e640a-2a5c-40ee-8b7e-1dcc9dc2c834 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.489097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e640a-2a5c-40ee-8b7e-1dcc9dc2c834 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.489369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e640a-2a5c-40ee-8b7e-1dcc9dc2c834 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.491432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 419/813] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:59.491432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e640a-2a5c-40ee-8b7e-1dcc9dc2c834 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.561389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.580340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919186-9e8e-4f13-9e46-d7403d1ba9e2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.604364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e640a-2a5c-40ee-8b7e-1dcc9dc2c834 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.617716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.618332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.618926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.619257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.620088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:59.620389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.622287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.632851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.634881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 395/814] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:59.635676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.644107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.644748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.645027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.646967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.646967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:59.646967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.647985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62772c-bf37-4d64-bf66-bc23649f2ea3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.657112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 420/815] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:59.657112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.657112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.657112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.674590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:59.675788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:59.748669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 421/816] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:34:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:34:59.748669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.763951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdae59-7b4f-4f47-8a14-54a4987260b5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.800914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.801894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.802349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.802869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.803833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:59.804318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.805962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.820511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 396/817] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:59.821692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.825434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.863678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e43a-7f2c-4ba8-afcb-ff07e1a86270 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.882523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:59.899942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.900688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.901037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.901380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.908954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.910495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:34:59.923713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:34:59.924765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:34:59.925750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 422/818] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:34:59.926381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:59.935692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb693dc-0512-4aae-86e3-e9b7c4c480bf None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:59.985511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:59.986497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:59.987071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:59.987546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:59.988459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:59.990042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.041325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f39c8-5c7d-48b3-8155-93fb7ffb8a0f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.074962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.075578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.075856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.076127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.082944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.084400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:00.095462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:00.096362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 423/819] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:00.097407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.118625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 397/820] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:34:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:00.118625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.167811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.183953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.240906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef064-4b66-4bda-8f62-ff9ed746b765 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.245095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd37bce-7b5d-4d22-a23d-e9ae0a46fcfb None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.294451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.295021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.295487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.295627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.295854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] PATH_INFO: `/v3/services/network` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.296098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.296378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.296484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.296688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.297420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.297716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.297889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.299131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:00.309309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:00.310363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:35:00.311226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:00.312677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 398/821] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:00.313619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.326601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 424/822] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.329158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.436186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1327-cc47-4e56-8553-9ad931208469 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.458121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.460979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.471446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227bc4-bdc3-40fc-a582-5da57818f2fc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.479283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.482792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.482792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.482792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.482792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.482792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.484810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.503753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 399/823] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.504950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.511731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.512814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.512814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.512976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.513576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] RBAC: Adding query filter params (name=network) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.513872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.515242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.520454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 425/824] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.521448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.627646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe7385-9e10-4d36-bac7-1d49def1ed0d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.646497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69912f7-03ab-46cf-b717-8309f55723de None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.664230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.664906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.665180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.665448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.680159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.682601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.690419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.691052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.691326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.691594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.692335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.692930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.694073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:00.703316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:00.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:00.705599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:00.705599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:00.705599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:00.705774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 426/825] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.706120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.707809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 400/826] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:00.713296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.758768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.817062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:00.873553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f4b6-dbc7-456c-aa9f-3cc702a4f15e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.911829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.912465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.912773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.913102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.913738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] RBAC: Adding query filter params (type=network) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.914022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.915446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.917060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb708c5-b802-47ac-91d4-85c51e57c211 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:00.920986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 427/827] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.929588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:00.971235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:00.972452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:00.972909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:00.973392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:00.974298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:00.974813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:00.976365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:00.991716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 401/828] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:00.997486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:01.056339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:01.072707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ed0d-4053-4ee8-a5d1-73e9ebfdf3fc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:01.105734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:01.116392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ac4f-8e6b-425d-ad8a-738c52011b2d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:01.123482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:01.124343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.125310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.125754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.126594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:01.128848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac288b5f-c2ac-4ed2-aaea-1c0c019d6364 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:01.164686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:01.165756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.166241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.166798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.175517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:01.177411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:01.191618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:01.192730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:01.193640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:01.196198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 402/829] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:01.202598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:01.224776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 428/830] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:01.342781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afdbd8-bb9c-49dd-9141-9cf40dc47f4c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:01.351533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61397-ba00-4b43-a9f0-587f885cc1df None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.352140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61397-ba00-4b43-a9f0-587f885cc1df None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.352645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61397-ba00-4b43-a9f0-587f885cc1df None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.356392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 429/831] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:01.361479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.362162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.362640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.388326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:01.390256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:01.404902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:01.405920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.406413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.406901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.407874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:01.410282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:01.413300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:01.439367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 403/832] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:01.445921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:01.458650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:01.499111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 430/833] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:01.556401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1f14-b9cb-4627-9887-89266aecd398 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:01.593495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:01.594147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.594420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.594689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/4b0dcea4fe9f4743900680142e94e505/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.610085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=4b0dcea4fe9f4743900680142e94e505, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:01.611514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:01.692241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 404/834] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:35:01 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/4b0dcea4fe9f4743900680142e94e505/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:35:01.784159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:01.869749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:01.896713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6059-e549-42b8-b2b4-c5a7e06061d5 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:01.933484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:01.934235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:01.934583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:01.934917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:01.945636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:01.951805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:01.952998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:01.954068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:01.958161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 431/835] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:01.961280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.027680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:02.070764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f072-f171-4855-80f3-b58aa4bdb363 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.107510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.108129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.108405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.108700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.109378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:02.109729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.111099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.126299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 405/836] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:02.127750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.234510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dcfad-454f-4cd0-b682-f5ecff60523b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.268547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.269208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.269488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.269761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.271721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:02.281725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.283194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-fff055f2-3e60-4e96-8461-f1efe55a8209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:02.298611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:02.299595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:02.300502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:02.300502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:02.300502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:02.304727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 432/837] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:02.306098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.383517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ec6a-0001-4fd5-a7f0-23cf6c36a081 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.383849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ec6a-0001-4fd5-a7f0-23cf6c36a081 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.384062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ec6a-0001-4fd5-a7f0-23cf6c36a081 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.385700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 433/838] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:02.390969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.391249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.391520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.413811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:02.415464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:02.418996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c674ba-ca46-40d7-8967-e6f851deada1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.440547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:02.455400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.456132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.456454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.456877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.457616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:02.458003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.459366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.476780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 406/839] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:02.478684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.502132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 434/840] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:02.590013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32e248-86fb-4865-9ce5-81e3033c8b9e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.625140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.625770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.626046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.626316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.633710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.635133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:02.646853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:02.647849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:02.648834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 407/841] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:02.654832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.757735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec31c9-e127-4df3-bc16-57f417882502 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.775837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:02.791357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.795554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.796430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.796958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.797443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.798380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:02.798883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.800614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.824817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 435/842] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:02.827340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.838863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:02.905924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4d25-2f7c-452a-a136-411ec4cf12c9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.940878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713689-f45c-431d-b0ba-3f3fc6fe9485 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:02.942814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.943516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.943880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.944887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:02.944887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:02.946350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:02.968466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:02.969559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:02.971059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:02.974606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 408/843] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:02.975452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:02.986060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:02.986674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:02.986953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:02.987224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.031433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.056583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.058580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86256cce-0e5d-4839-88fd-7c18b3e855e1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.091490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ab44e-b31f-4d38-a2c7-ba0ef88c129b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.093766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.125731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.126337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.126614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.126883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.127509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:03.127810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.129315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1732b66-3324-45f6-9745-5539c24ce8f3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.139979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 409/844] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:03.139979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281594b-e1c7-4de5-aa2c-983b9d431f42 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.139979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281594b-e1c7-4de5-aa2c-983b9d431f42 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.139979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281594b-e1c7-4de5-aa2c-983b9d431f42 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.139979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 410/845] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:03.141163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281594b-e1c7-4de5-aa2c-983b9d431f42 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.174689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 436/846] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:35:03.174689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.174689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.174689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.192175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:03.193395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:03.257171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281594b-e1c7-4de5-aa2c-983b9d431f42 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.276613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 437/847] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:03.276613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.278616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.308408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.309156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.309526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.309902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.310618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:03.311022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.312577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.325036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 411/848] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:03.397020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd7931-cab5-45d1-85db-9b977914016a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.438269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.439225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.439652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.440097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.453488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.455319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:03.471854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:03.473083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:03.474207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:03.474207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:03.474207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:03.475893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 438/849] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:03.481409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.518776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.551486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.602976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d73c5c-3da2-4c07-a1d4-32cdbdf2b80a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.617738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.647264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.647880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.648159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.648428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.649467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:03.649775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.651319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.668001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 412/850] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:03.669914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543c0f-40e3-4a4e-a954-981bf605e2b5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.673381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.710267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.711278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.711851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.712327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.713175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.714807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:03.724665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:03.725660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:03.726584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:03.729437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 439/851] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:03.735887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.782503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.792325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c02dcb-e871-4ba2-9a45-f47799f29300 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.832631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.833561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.833841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.834113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.841240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.842673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.848187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b02946-aa3a-4783-a0af-1049a571d3e2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-06502ba7-6f63-40d7-9672-5edd1eb57360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:03.854260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:03.855949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 413/852] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e96075-3e50-46bd-aa94-32613fac9db9 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.857262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e96075-3e50-46bd-aa94-32613fac9db9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.857881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e96075-3e50-46bd-aa94-32613fac9db9 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.860918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 414/853] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:03.862555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e96075-3e50-46bd-aa94-32613fac9db9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:03.874321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:03.889667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:03.890577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.891897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.891897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.891897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:03.892355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:03.893748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69738f0f-24f6-444e-a635-f7a207dab4bf None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:03.898806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 440/854] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:03.900278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:03.900803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:03.901283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:03.920873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:03.922064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:03.983167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e96075-3e50-46bd-aa94-32613fac9db9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.003950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 441/855] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:04.005032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.033158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.034791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.035298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.035982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.037340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:04.038066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:04.039981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:04.056891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 415/856] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:04.062635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.082005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:04.122446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf31f3d-1fde-42a0-aa8c-d0ffd62c1878 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.142174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:04.172036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.172670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.172950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.173220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.173846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:04.174145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:04.175513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:04.184741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 442/857] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:04.194590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaf845-63a2-4ae3-a4ce-7e6c8ef03ace None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.235334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.236334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.236850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.237372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.238321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=38ca2939be224113a823b0bbba092f0c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:04.238865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:04.240540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:04.252755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 416/858] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/role_assignments?user.id=38ca2939be224113a823b0bbba092f0c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:04.274936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.399640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f323002-e17c-4dec-b6ec-d57dd7b4ca2c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.437570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.438207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.438483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.438747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.450972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:04.456061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:04.457042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:04.458213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 443/859] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:04.463075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.554297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:04.585395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107cd76-3776-4d4e-ad61-e3d57e365782 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.624518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.625583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.626091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.626599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.627494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:04.628002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:04.629624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:04.640118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 417/860] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:04.645410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.689695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:04.764669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e840-8c04-47b7-bd2a-1aa3ed741be4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.801749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.802385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.802664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:04.802936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:04.814308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:04.815777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:04.831879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:04.832985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:04.834270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:04.834270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:04.834270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:04.834270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 444/861] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:04.838866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:04.949302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b4f56-1b46-449f-b578-39b1dbf67073 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:04.998865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:04.999481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:04.999762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.000033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.000710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:05.001011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.002708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:05.012308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.018178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 418/862] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:05.023643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.120944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.130228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c31f96-d738-441c-af16-8f220ea62b95 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:05.165673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:05.167398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.167981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.167981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.175356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.176832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:05.188791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:05.189799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:05.191400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 445/863] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:35:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:05.195470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.302826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6d9c-0bfd-44e4-abb2-6f7c6ac17e2c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:05.339137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:05.340151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.340151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.340457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.341011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:05.341312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.342855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d1a62-e1b2-4d60-9701-f14f78161849 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:05.361235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 419/864] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:35:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:05.369671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.391582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb579e-ad66-419e-8d57-555fe444df8f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.391885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb579e-ad66-419e-8d57-555fe444df8f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.392123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb579e-ad66-419e-8d57-555fe444df8f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.394184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 420/865] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:05.399342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231748-aef9-4674-8943-278107f75f2e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.399624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231748-aef9-4674-8943-278107f75f2e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.399896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231748-aef9-4674-8943-278107f75f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.419941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dd231748-aef9-4674-8943-278107f75f2e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:05.421197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dd231748-aef9-4674-8943-278107f75f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:05.489916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.497025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51408-4617-4eff-aff2-a850654af85a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:05.515933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 421/866] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:05.534260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:05.534861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.535140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.535410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.554412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.605477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.606924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:05.708754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 446/867] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:05.714479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231748-aef9-4674-8943-278107f75f2e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.799900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.820680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231748-aef9-4674-8943-278107f75f2e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:05.861424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:05.862407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.862761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.863176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.863651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.875474 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.877259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:05.892802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:05.893822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:05.894752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:05.894752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:05.894752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:05.896835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 422/868] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:05.902903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:05.934460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79830d54-aa53-4552-8154-b7b1464b9804 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:05.947794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:05.980648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:05.981269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:05.981542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:05.981812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:05.983070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:05.984764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.019148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c9-31b6-41be-8464-15a79f510222 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:06.055166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:06.055830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.056112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.056470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.057159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:06.057459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:06.058985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.064717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 447/869] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:05 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:06.078825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 423/870] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:06.084747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.207022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04175-eab2-4b62-ab54-95e93c65f8cd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:06.215329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:06.242378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:06.243009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.243286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.243550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.250334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:06.251863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-2e236254-c9f8-4f91-86d5-c2f0687bca77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:06.264213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:06.265199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:06.266123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 448/871] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:06.271331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.314256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49eef-a538-406e-b850-84424ced5bfc None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.314587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49eef-a538-406e-b850-84424ced5bfc None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.314806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49eef-a538-406e-b850-84424ced5bfc None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.316413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 449/872] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:06.321454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0277-5296-4c83-b272-e6f815ecedd1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.321742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0277-5296-4c83-b272-e6f815ecedd1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.322020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f0277-5296-4c83-b272-e6f815ecedd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.341523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0b6f0277-5296-4c83-b272-e6f815ecedd1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:06.342637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0b6f0277-5296-4c83-b272-e6f815ecedd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:06.377169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:06.380855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a904b-71dd-41ac-94c8-55d0d91823ea None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:06.419349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:06.419961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.420280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.420508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.421245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:06.421547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:06.422983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.428953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 450/873] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:06.430071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea9a5-6a3e-4fb3-b3e2-37e7e3aefc5c None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.430353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea9a5-6a3e-4fb3-b3e2-37e7e3aefc5c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.430622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea9a5-6a3e-4fb3-b3e2-37e7e3aefc5c None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.436492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 451/874] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:06.438718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.439151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.439985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.443593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 424/875] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:06.450633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.471367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:06.473161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:06.572627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 452/876] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:06.596991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308e434-344c-4268-96a2-2dea1fac4868 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:06.632023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:06.633048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.633556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.634027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.634958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=4b0dcea4fe9f4743900680142e94e505) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:06.635470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:06.637854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.644545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 425/877] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:06 2022] GET /identity/v3/role_assignments?user.id=4b0dcea4fe9f4743900680142e94e505&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:06.703241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.735052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:06.827969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab963f16-e1af-4970-8f4c-519b660917cc None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:06.865531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:06.866487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:06.866974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:06.867457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:06.868247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:06.869874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:06.879876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:06.881028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:06.881977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:06.883635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 453/878] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:06.889631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.889999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:06.921316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:07.015430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:07.029521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010ccb8-bfdf-496c-9f41-6829373c53dc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:07.031044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a513af1-e77d-4d13-9e69-a16f5af60ce1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:07.074010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:07.074420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:07.074636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:07.074899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:07.075067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:07.075262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:07.075359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:07.075573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:07.075893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:07.076212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:07.076796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:07.077644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73482e-066d-489d-9a6c-f4b8ea57a7ec None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:07.078157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:07.084306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 426/879] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:07.091559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:07.160647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 454/880] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:06 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:07.203795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:07.222137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ea81-e4cb-4ac1-9d88-003182ddd446 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:07.268974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:07.270035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:07.270321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:07.270947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:07.272232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:07.272789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:07.273939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c65dd-e4f3-43fc-829a-c72dd7005bcd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:07.280175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 427/881] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:08.081773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76f47-1695-4af3-b370-0bbb610b43a6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.082278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76f47-1695-4af3-b370-0bbb610b43a6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.082357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76f47-1695-4af3-b370-0bbb610b43a6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.083883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 455/882] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:08.089587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.089957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.090232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.108445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:08.109670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:08.177749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 428/883] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:08.449683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76f47-1695-4af3-b370-0bbb610b43a6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:08.563800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76f47-1695-4af3-b370-0bbb610b43a6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:08.601089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:08.602130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.602622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.603127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.603923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:08.605584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-9ae4105d-637d-4442-8b6c-d609e1661560 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:08.615320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:08.616358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:08.617278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:08.620929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 456/884] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:08.628010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:08.712823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ec43-76f6-4290-b082-f9975b34e0a3 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.713449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ec43-76f6-4290-b082-f9975b34e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.714081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34ec43-76f6-4290-b082-f9975b34e0a3 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.716028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 457/885] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:08.723069 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:08.724697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.725253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.725739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.743028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260094-f158-45b4-b7ab-02dbf94626ae None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:08.746255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:08.747758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:08.758521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:08.784059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:08.785399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.785957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.786398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.787353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:08.787918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:08.790418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:08.801097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 429/886] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:08.802805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:08.838408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 458/887] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:08.918392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59034c-9eed-4984-a603-ff196dfbe4ed None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:08.954384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:08.954889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:08.955166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:08.955498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:08.956134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:08.956489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:08.957949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:08.963308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 430/888] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:08.969302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.074452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ff570-4320-45a3-9a09-4305ff6aeb25 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.111104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.112509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.113047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.113519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.114433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] RBAC: Adding query filter params (interface=public, service_id=b704056839ef4f5db90de9a66ddb8fda, region_id=RegionOne) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:09.114962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.116558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.126779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.126982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 459/889] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:35:08 2022] GET /identity/v3/endpoints?service_id=b704056839ef4f5db90de9a66ddb8fda&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:09.128510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.131426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.141748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.237317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8c4e-156e-4898-946e-226a4f58ce06 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.250981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf5ca-f145-4d88-a19f-e21b00423fae None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.273299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.273902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.274172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.274446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.275044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.276561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c507a-4c9b-4fd9-87fb-78efb96c1f4c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.282429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 460/890] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:35:09.283659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbbe14-76ea-4459-9553-5f888b1ddbb2 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.284002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbbe14-76ea-4459-9553-5f888b1ddbb2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.284286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbbe14-76ea-4459-9553-5f888b1ddbb2 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.285709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 461/891] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:09.286775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8bae-d3a1-4bf0-8e86-11e5b42c7f2d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.287063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8bae-d3a1-4bf0-8e86-11e5b42c7f2d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.287333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8bae-d3a1-4bf0-8e86-11e5b42c7f2d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.288767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 462/892] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:09.290917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.291583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.291863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.292136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.294261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.294794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.295068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.312072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:09.315236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:09.316475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-fe619e76-a3e6-4753-9724-9e801030ab83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:09.318441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:09.319440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:09.320326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:09.321547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 431/893] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:09.322625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.322914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.324199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.345135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:09.346388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:09.400634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 463/894] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:09.400634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.403314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.418660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.428052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 432/895] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:09.528549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983cadd-7b34-47af-9a64-9a6a64353026 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.564939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.571358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.579063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 464/896] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:09.590687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.676609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.697211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b8e9-ffd6-4bad-8940-62cba805b171 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.744468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.745178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.745457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.745877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.753071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.757199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.758667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:09.774495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:09.775566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:09.777271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:09.777271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:09.777271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:09.777271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 433/897] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:09.777271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.800482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae964a-f91b-4d18-a1e7-99eb3b88792b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.829513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.836863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.837574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.837851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.838122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.838760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.840186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:09.849467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:09.850618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:09.851575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 465/898] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:09.852401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:09.893876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3abed-8ae9-4c80-a8fe-db57161a6021 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.927121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.927756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.928035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.928307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:09.928996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:09.930367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:09.961596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729d68-64f0-4c61-95c1-552e2151c545 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:09.987031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:09.994563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:09.995780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:09.996263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:09.996539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.012730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:10.012730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.012730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.013120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 434/899] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:09 2022] POST /identity/v3/services => generated 241 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:10.013120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.016505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 466/900] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:10.026244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.145723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0914ab-085a-42c7-a571-422037d4db11 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.146365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42815889-95ef-4c48-8218-c8fbc2d6b138 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.147993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:10.190259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.190924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.191204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.191476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.193914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.194601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.195183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.196181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.197141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:10.197266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.198888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.200139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.202008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.206119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 435/901] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:10.211481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:10.216261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:10.217318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:10.218788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 467/902] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:10.222957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.288396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:10.338332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254284-1697-4950-9664-a366db3ffd44 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.355013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58b46-319f-4e51-acaf-72d4cd74afbd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.379145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.380094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.380556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.381028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.381858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:10.382333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.383905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.395471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 436/903] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:10.397233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.399247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.400007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.400375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.400989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.403410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:10.403799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.405369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.434116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 468/904] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:10.435973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.436879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:10.528207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0423-aaf9-4ab7-a5cf-fee9b54b2499 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.562188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c620f0-b4c0-4ebd-8673-0125ccca0c25 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.566341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.567336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.567829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.568312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.569266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] RBAC: Adding query filter params (interface=public, service_id=1e66dd3cdd364627b4053fe9b01d63bd, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:10.569804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.570478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:10.571726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.583384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 437/905] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/endpoints?service_id=1e66dd3cdd364627b4053fe9b01d63bd&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:10.584975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.603864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.604560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.604803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.605312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.692926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.694410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.697312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:10.706180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052121f5-ed37-4bfe-99b0-f5c88ab1c9b2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.741340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.742304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.742804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.743274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.744094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.747532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:10.761716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 438/906] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:35:10.808807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 469/907] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:10.817433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:10.931174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2405c-d0a2-4b1a-9a89-f8d765c0541c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:10.977917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:10.978618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:10.978938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:10.979208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:10.990855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:10.992296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:11.008653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:11.009709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:11.011879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:11.011879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:11.011879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:11.011879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 439/908] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:11.018392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.027969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.125085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fdb1-55b6-4ee0-8cf2-51091cad4eb9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.165584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:11.166233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.166510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.166906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.167787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:11.168089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:11.169502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81265da9-2a9e-4c62-98ef-d49ca2862abc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.181707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 470/909] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:11.187396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.206322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.286770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4277f-3b92-4b8a-95a3-98bb652b751a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.287123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4277f-3b92-4b8a-95a3-98bb652b751a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.287325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4277f-3b92-4b8a-95a3-98bb652b751a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.289011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 471/910] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:11.294177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.294890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.295296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.300580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d84a-9eef-46d2-ac0c-25e155dfd9f7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.320324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:11.322006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:11.344380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:11.345433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.345719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.345994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.355264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:11.357400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:11.371399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:11.372354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:11.373394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 440/911] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:11.380148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.400328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.410113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 472/912] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:11.466449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.500023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445c0d-dd91-4904-885c-df2967a119dd None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.535543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:11.536540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.537047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.537537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.538446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:11.538948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:11.540605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.554377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 441/913] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:11.561013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.671802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23050aeb-c0b6-4e84-9831-03eaadc083dd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.686360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.717763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:11.718295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.718575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.718846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.719738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] RBAC: Adding query filter params (role.id=828a215d857f4a559fa67497b95a5044, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=4b0dcea4fe9f4743900680142e94e505) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:11.720045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:11.722129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.729453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 473/914] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/role_assignments?user.id=4b0dcea4fe9f4743900680142e94e505&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=828a215d857f4a559fa67497b95a5044 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:11.805976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1bda-e646-48a3-b559-c96d3bd5faf2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.841397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.848171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:11.848998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.849108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.849372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.849968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:11.851350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-047ed9a2-cb3a-4eb0-9b5b-a886a49a1d1f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:11.862798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:11.863890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:11.864809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 442/915] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:11.872880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:11.937520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:11.983566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039960-538e-49ba-8288-57918a85cd27 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.983891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039960-538e-49ba-8288-57918a85cd27 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.984059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039960-538e-49ba-8288-57918a85cd27 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:11.985706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 443/916] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:11.986062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78105-424c-4c9b-9262-684ca91306da None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:11.992608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53119-8869-4989-9913-686ecc922b6d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:11.992870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53119-8869-4989-9913-686ecc922b6d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:11.993140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53119-8869-4989-9913-686ecc922b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.013464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-99b53119-8869-4989-9913-686ecc922b6d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:12.014697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-99b53119-8869-4989-9913-686ecc922b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:12.031852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.033144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.033706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.034287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.035448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:12.035981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.037573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.045354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 474/917] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:12.050448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.099746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 444/918] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:12.158903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86754b5-7d99-4fb4-a4fc-d1cab32d245a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:12.184531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:12.196543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.197426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.197916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.204780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.204780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:12.204780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.204780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.207521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 475/919] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 5 10:35:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:12.213764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53119-8869-4989-9913-686ecc922b6d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.319562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53119-8869-4989-9913-686ecc922b6d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:12.344764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:12.356245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.356892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.357167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.359114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.359114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.359535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.408557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.479365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 445/920] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:12.530784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b80b-0733-4176-838d-ca7d03da0614 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:12.579730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.580809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.581295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.581768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.582647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.584315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:12.595320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:12.596446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:12.597368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:12.600370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 476/921] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:12.606808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.715259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd46056-952f-482b-abc6-6cbdaaa775db None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:12.750568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.751610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.752103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.752670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.753528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:12.754030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.755602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57747fe-2c0e-4350-92e4-c6fa82d9fb4d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.761683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 446/922] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:12.767756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.822373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:12.873795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0153-ec3c-4835-bb5a-a090e376c6f4 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.874303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0153-ec3c-4835-bb5a-a090e376c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.874303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0153-ec3c-4835-bb5a-a090e376c6f4 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.876793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 447/923] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:12.880320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dcb27-fd2f-4c86-a044-ac272c028a81 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:12.881087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.881378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.881645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.903257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:12.904501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:12.923908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:12.924521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:12.924831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:12.925102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:12.925748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:12.926033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:12.927416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:12.934151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 477/924] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:12.940755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:12.968966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:13.004731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 448/925] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:13.064405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c81b-4915-488d-a62c-3b70b37077e2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.080903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:13.100786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.101451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.101735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.102006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.102713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] RBAC: Adding query filter params (interface=public, service_id=f5a15b33bd254294a7f78554ce077756, region_id=RegionOne) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:13.103020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.105092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:13.110617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 478/926] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:35:12 2022] GET /identity/v3/endpoints?service_id=f5a15b33bd254294a7f78554ce077756&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:13.116219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:13.223687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e9a4c-818a-4e0c-8b75-123784ec2141 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.259130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.260067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.261133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.261777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.262614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.264190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:13.270834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 449/927] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:13 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:35:13.299696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:13.418801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e518c-8d6d-4a98-8722-7d6f1de3e00d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.458012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.458651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.458931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.459206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.459792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.461277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:13.470583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:13.471555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:13.472674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 479/928] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 5 10:35:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:13.478616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:13.522462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:13.585678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c38e1-d65d-4037-98af-0dc28064b66b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.622773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.623744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.624233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.624758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.625648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:13.626175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.627795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8dae-dc60-4bfe-90ef-a053e4915d68 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:13.634159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 450/929] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:13.640145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:13.687954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:13.752961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987615d8-2b56-48b5-8f24-e9b071444cc9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.757413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ce02e-22a9-4733-916d-6bbac1cf4f3f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.757922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ce02e-22a9-4733-916d-6bbac1cf4f3f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.758422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ce02e-22a9-4733-916d-6bbac1cf4f3f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.761347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 451/930] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:13.765709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.766231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.766788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.787784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:13.788229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.788868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.789145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.789412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.790036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:13.790331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.790673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:13.791730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:13.797847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 480/931] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:13.803252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:13.887580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 452/932] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:13.918181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ccdd6-26e7-4bae-ab1b-2c629701efe5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:13.928943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:13.961496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:13.967311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:13.967311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:13.967311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:13.967311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:13.967311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:14.068833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 481/933] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:14.174590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.209911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:14.283000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15331-e603-439d-954a-3557c0a25be3 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:14.324801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:14.325358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.325634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.325902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.336640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-519d1e2c-f9bd-4a8d-93e3-2053d25439ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:14.341537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:14.342505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:14.343368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:14.347511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 453/934] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:14.348900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.461825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145a505-bb0f-4272-aca4-be7f3b0d6011 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:14.476161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d821-3a9a-4622-a6c4-2af9fc356058 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.476457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d821-3a9a-4622-a6c4-2af9fc356058 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.476748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d821-3a9a-4622-a6c4-2af9fc356058 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.478349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 454/935] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:14.483726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.483962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.484215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.501179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:14.501806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.502086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.502356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.503031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:14.503333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:14.504203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:14.504775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:14.505447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:14.517070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 482/936] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:14.522413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.554840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:14.597172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 455/937] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:14.638631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee564202-dd75-4f5f-bec7-b5113b410604 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:14.674552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:14.675183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.675463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.675735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.686183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:14.687651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:14.704047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:14.706231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:14.708278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:14.708278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:14.708278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:14.708278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 483/938] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:14.711129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.731847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:14.819883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeff85-74ae-486d-953a-a835ad701b87 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:14.858491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:14.859024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:14.859305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:14.859579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:14.860229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:14.860531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:14.861926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:14.868414 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.876671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 456/939] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:14.883448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:14.960940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:14.989308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f14898-5741-43d2-b049-4af96a044203 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:14.990403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:15.024153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2322f56-90bb-454e-850d-d9a991e7349f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.029031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.029718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.030086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.030426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.031152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.032724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.035392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING keystone.server.flask.common [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 10:35:15.063739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.064372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.064686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.064958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.072763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.075072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.081950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.sql.core [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:35:15.081950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 10:35:15.081950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [parameters: {'id': '459aa8a2edc24e47be41b489a3e65660', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 10:35:15.081950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:15.086968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:15.089021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:15.091072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:15.100610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 457/940] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:35:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:15.100610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 459aa8a2edc24e47be41b489a3e65660.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 459aa8a2edc24e47be41b489a3e65660. Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:35:15.103281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application result.read() Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 05 10:35:15.109856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application yield resource Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise self.value Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application session.commit() Sep 05 10:35:15.111516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:35:15.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:35:15.113828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application result.read() Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:35:15.114864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [parameters: {'id': '459aa8a2edc24e47be41b489a3e65660', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.115953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:15.124417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 459aa8a2edc24e47be41b489a3e65660. Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 484/941] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 5 10:35:14 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:15.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.235104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077b66-e65f-4af7-adf3-bb28d5e3ded2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.251030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b4047-f4ea-465a-a4ed-21e33b1279c3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.271104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:15.283250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.287965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.287965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.287965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.292109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.293999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.299689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.300608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.301152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.301651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.302645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:15.303170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.304817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:15.305820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:15.306775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:15.308422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 485/942] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:15.313222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.318945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:15.334603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 458/943] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:15.340053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.444400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec473-f348-4121-87fb-0ef0af27b454 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.451713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e6a7-baed-4e7a-8979-c1a19ce6493b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.481947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.482555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.482835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.483105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.483761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:15.484059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.484892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.485515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.485628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68cb1-a11b-41bf-a952-ab19b8227bef None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.485782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.486052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.495963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.497519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.512629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 486/944] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:15.512629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55029-61ff-4e0e-8647-7c1571a0dc61 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.512629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55029-61ff-4e0e-8647-7c1571a0dc61 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.512629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55029-61ff-4e0e-8647-7c1571a0dc61 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-ae96a624-8596-4c23-9726-fa1eb51d7a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:15.513067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:15.513972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:15.514883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:15.514883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:15.514883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:15.514883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 459/945] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:15.515960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 487/946] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:15.521856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.522045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.522190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.536093 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55029-61ff-4e0e-8647-7c1571a0dc61 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.544303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:15.545832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:15.601442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:15.639307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:15.651737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 460/947] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:15.665132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55029-61ff-4e0e-8647-7c1571a0dc61 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.704317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.704873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.705150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.705442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.706064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:15.706366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.707742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.722580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 488/948] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:15.728821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.838104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca1d5-02d4-4f46-a4ab-28e930ed6b34 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:15.875075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:15.875707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:15.875979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:15.876248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:15.883135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:15.884644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:15.896931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:15.897875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:15.898969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 461/949] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:15.906437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.916772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:15.961612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:16.028444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fe3e-fba2-4b6b-a144-6d7b243cd77d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.029615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe60de-0a36-49c5-a501-a1184a4a8f99 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.040917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:16.065855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.066453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.066743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.066999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.067582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.069011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.069645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.070436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.070864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.071282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.072133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:16.072614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.075322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:16.079114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:16.080542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:16.081778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:16.084933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 462/950] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:16.086673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:16.098866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 489/951] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:16.100396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:16.194545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153564ec-c42a-40fa-8186-7c98db1a0268 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.196158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:16.217544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6d965-0585-4315-b364-80e5efad9cd6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.230455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.231058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.231333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.231605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.232226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:16.232524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.233892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91cce4-720b-40f4-8d5c-78da8b981335 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.240744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 463/952] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:16.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37eaf-e437-4149-bf06-ed2a47cae13f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.242320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37eaf-e437-4149-bf06-ed2a47cae13f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.242593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f37eaf-e437-4149-bf06-ed2a47cae13f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.244000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 464/953] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:16.249804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f37eaf-e437-4149-bf06-ed2a47cae13f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:16.261174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.262079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.262355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.262627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/4b0dcea4fe9f4743900680142e94e505/roles/828a215d857f4a559fa67497b95a5044` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.265245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=4b0dcea4fe9f4743900680142e94e505, role_id=828a215d857f4a559fa67497b95a5044)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.266676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e64ae-50e4-4ece-9f9c-e655bc455bed None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.343063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 490/954] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:35:16 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/4b0dcea4fe9f4743900680142e94e505/roles/828a215d857f4a559fa67497b95a5044 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:35:16.344737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.345202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.349273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.363699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f37eaf-e437-4149-bf06-ed2a47cae13f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.366837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:16.368804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:16.402724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:16.406636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.407557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.407833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.408095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.408782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:16.409081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.410497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.416631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 465/955] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:16.422020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:16.456729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:16.461818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 491/956] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:16.534383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdbd5b-2fc6-4a63-8e12-29945f9c7216 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.570285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.570890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.571165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.571434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.572092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.574551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.706986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 466/957] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:16.733683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:16.859338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d36d81-2df9-4f19-a20c-d07a101b8914 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:16.903417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:16.904485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:16.904996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:16.905492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:16.906292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:16.907868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:16.918332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:16.919361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:16.920237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:16.927637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 492/958] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:16.929286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:17.023440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:17.039159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47b31-bf3e-477a-a93a-7f6a66a0e334 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:17.074867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:17.075481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:17.075756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:17.076024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:17.076942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:17.077240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:17.078598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa93e92-f530-437f-b4f4-526955d61f3b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:17.088112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 467/959] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:17.090371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:17.114592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:17.200030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff8208-b7d4-42ac-a8be-1b88cb99ceb5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:17.237859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:17.238772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:17.239211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:17.239631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:17.240411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] RBAC: Adding query filter params (type=compute) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:17.240902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:17.242439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c28164-df41-40b0-a84a-dc9a8abe1bfa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:17.248158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 493/960] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:17.638848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d1d0-881e-4c77-a822-0657d2deedf5 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:17.639201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d1d0-881e-4c77-a822-0657d2deedf5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:17.639504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d1d0-881e-4c77-a822-0657d2deedf5 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:17.641177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 468/961] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:17.646602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:17.647445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:17.647944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:17.669178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:17.670723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:17.743867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 494/962] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:18.033202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d1d0-881e-4c77-a822-0657d2deedf5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:18.142849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d1d0-881e-4c77-a822-0657d2deedf5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:18.178713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:18.179689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.180180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.180676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.181517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:18.183258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:18.186019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING keystone.server.flask.common [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 10:35:18.251890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.sql.core [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:35:18.251890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 10:35:18.251890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [parameters: {'user_id': '28e4c05763e746eebebad10c0e75f4bc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 10:35:18.251890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93530) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-d1e41099-06b4-4b15-8ac9-1660d69734ad None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result.read() Sep 05 10:35:18.260158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:35:18.261913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application yield resource Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise self.value Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application session.commit() Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:35:18.262902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:35:18.263897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:35:18.264831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application result.read() Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:35:18.265717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [parameters: {'user_id': '28e4c05763e746eebebad10c0e75f4bc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:18.268693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 05 10:35:18.270621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 10:35:18.273863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.275562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 469/963] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 5 10:35:18 2022] POST /identity/v3/users => generated 160 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:18.281504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:18.296969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:18.388757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822523-44cc-441e-aa2f-326266b61967 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:18.400676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddaa3a-5e39-4741-8d02-11f3f81668e1 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.401083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddaa3a-5e39-4741-8d02-11f3f81668e1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.401317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddaa3a-5e39-4741-8d02-11f3f81668e1 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.407306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 470/964] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:18.412384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7fb9-490b-4027-b4b2-fdb2222ed497 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.412801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7fb9-490b-4027-b4b2-fdb2222ed497 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.413081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7fb9-490b-4027-b4b2-fdb2222ed497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.430893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:18.431523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.431883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.432783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.437507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-78fa7fb9-490b-4027-b4b2-fdb2222ed497 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:18.439047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-78fa7fb9-490b-4027-b4b2-fdb2222ed497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:18.440123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:18.441670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:18.448643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:18.455549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:18.463262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 495/965] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:18.465273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:18.533803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 471/966] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:18.555996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:18.583525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331c95-7a41-4943-9a5a-c1b901e70316 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:18.624528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:18.625178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.625459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.625730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.626432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:18.626736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:18.628174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1a01-79f7-4f35-8a0e-6b0eb6eb9cc1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:18.664819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 496/967] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 5 10:35:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:18.718269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab24f-d71a-4fc1-b975-0e295229ff64 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.718911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab24f-d71a-4fc1-b975-0e295229ff64 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.719417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab24f-d71a-4fc1-b975-0e295229ff64 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.721402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 472/968] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:18.727465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.728086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.728571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.750793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:18.752397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:18.811817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab24f-d71a-4fc1-b975-0e295229ff64 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:18.829857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 497/969] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:18.925870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab24f-d71a-4fc1-b975-0e295229ff64 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:18.965367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:18.966006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:18.966285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:18.966556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:18.977313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:18.982417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:18.984472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:18.986541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 473/970] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:18.989343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.051952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.094100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500325e-f44a-4433-8266-49ecfb93cf7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.101147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.104753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.128688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.129311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.129583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.129854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.130520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.130822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.132237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.141066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 498/971] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:19.146423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.211835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5f60-4b2b-465e-a162-14e75bb91f5a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.248525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d382a-7dac-4b95-b5f8-6600cb86f338 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.249124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.249760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.250308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.250641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.252153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.253780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-bc3db66f-0a0b-4a06-bd72-3983d5658eed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:19.266087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:19.267337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:19.268360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 474/972] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:19.269577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5854467-43cc-4bd3-aa74-b775cdbd4683 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.269577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5854467-43cc-4bd3-aa74-b775cdbd4683 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.269577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5854467-43cc-4bd3-aa74-b775cdbd4683 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.270411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 475/973] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:19.273167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5854467-43cc-4bd3-aa74-b775cdbd4683 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.275197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.288280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.297100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.297100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.297100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.299874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.301338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-976145a6-ca16-4211-8d35-934c5dfec8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:19.315198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:19.316180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:19.317144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:19.317144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:19.317144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:19.317144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 499/974] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:19.317595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.317759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.318019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.336866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:19.338053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:19.346774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.381494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5854467-43cc-4bd3-aa74-b775cdbd4683 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.405150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 500/975] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:19.405991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.416456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790775b3-d828-4020-aa63-620909beab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.417246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790775b3-d828-4020-aa63-620909beab74 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.417651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790775b3-d828-4020-aa63-620909beab74 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.418070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790775b3-d828-4020-aa63-620909beab74 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.418830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790775b3-d828-4020-aa63-620909beab74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.419255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790775b3-d828-4020-aa63-620909beab74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.420759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790775b3-d828-4020-aa63-620909beab74 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.426483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 476/976] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:19.431807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790775b3-d828-4020-aa63-620909beab74 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.513357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ab6e-5f8a-457b-8ef8-fdec98fb2989 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.521189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.545263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790775b3-d828-4020-aa63-620909beab74 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.547693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.549184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.549469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.549741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.550390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.550736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.552119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.564786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 501/977] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:19.570200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.585073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.592876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.593540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.594092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.594425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.595216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.595511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.597671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.604691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 477/978] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:19.610332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.675503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d910b9f-f177-4550-84d1-4c32d0cea23e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.708970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.709600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.709880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.710154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.714688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460883e1-808d-4c32-bbf1-3c8061e7ef09 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.718417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.719867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:19.731797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:19.732808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 502/979] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:19.734349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.754794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.755401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.755680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.755952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.756748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] RBAC: Adding query filter params (interface=admin, service_id=f5a15b33bd254294a7f78554ce077756, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.757057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.758406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.763373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 478/980] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/endpoints?service_id=f5a15b33bd254294a7f78554ce077756&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:19.764143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.764471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.821746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:19.837435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb242-c9a9-4751-87d6-0363d510f920 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.863315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d143-cf42-44ff-b9cd-5c0102b66660 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:19.871744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.872354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.872664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.872939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.873586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.874949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.896309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:19.896937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:19.897216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:19.897489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:19.898202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:19.898502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:19.899894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:19.917752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 479/981] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:19.918528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:19.993411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 503/982] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:19 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:19.994170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:20.021777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e317-b619-41a7-8281-b2d8aa741005 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:20.041500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:20.071170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:20.071809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:20.072458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:20.073811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:20.076015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:20.077724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:20.084367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 480/983] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:35:20.117646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:20.136930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6c77-57c5-4469-817e-0d2854cb9ff8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:20.177539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:20.177539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:20.177823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:20.178080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:20.251249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:20.252751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:20.342590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:20.358800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 504/984] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:20.364279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:20.466919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ab8b-4965-4cc4-82c1-b7e884de162f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:20.503045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:20.503670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:20.503943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:20.504211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:20.514560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:20.515979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:20.531128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:20.535298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:20.536434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:20.536434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:20.536434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:20.536434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 481/985] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:20.537879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:20.640808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31bfd2-a503-48f5-bb8a-9bd477453ce0 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:20.676271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:20.676972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:20.677206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:20.677447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:20.678136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:20.678443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:20.679814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:20.695809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 505/986] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:20.697448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:20.728930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:20.798885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0be41-b158-4f0e-97fc-d878294cad0a None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:20.832393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:20.833040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:20.833321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:20.833592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:20.840999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:20.842437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:20.853414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:20.854860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:20.855818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:20.859998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 482/987] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:20.861398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:20.910772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:20.966622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a66eb-289d-4f96-918a-d467f399a139 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:21.001396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:21.001985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:21.002267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:21.002536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:21.003253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:21.003556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:21.005023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63565ef8-7ad0-4b1c-bba2-e5281c8c4dae None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:21.019560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 506/988] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:21.025304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:21.120297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:21.133313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfef058-feb0-43a5-a02d-97863e0fbb9f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:21.166816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:21.167420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:21.167696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:21.167966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:21.168731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] RBAC: Adding query filter params (role.id=828a215d857f4a559fa67497b95a5044, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=4b0dcea4fe9f4743900680142e94e505) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:21.169041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:21.170480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300971e9-e4b5-4912-83b0-b5a1af9bd511 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:21.184640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 483/989] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:21 2022] GET /identity/v3/role_assignments?user.id=4b0dcea4fe9f4743900680142e94e505&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=828a215d857f4a559fa67497b95a5044 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:21.956452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9943c-2f30-4942-bd39-6850f94e884c None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:21.956452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9943c-2f30-4942-bd39-6850f94e884c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:21.956452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9943c-2f30-4942-bd39-6850f94e884c None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:21.957385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 507/990] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:21.962767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:21.963163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:21.963443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:21.981517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:21.982701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:22.014094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee98e-96cf-43cb-a8bf-38d0b29746e5 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.014392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee98e-96cf-43cb-a8bf-38d0b29746e5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.014631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee98e-96cf-43cb-a8bf-38d0b29746e5 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.016088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 508/991] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:22.020656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.020937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.021209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.038771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:22.039942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:22.050531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 484/992] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:22.108751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 509/993] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:22.322247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.376485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.404240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.413142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.422642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf448e4-3965-4172-a7b5-feea2a4940df None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.458491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.459122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.459395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.459664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.460284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.461695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:22.472422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:22.474658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:22.475570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 485/994] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:22.479434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.487054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d6ba-fd8a-4cfb-9865-46f7af56f3e5 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.523321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.524179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.524662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.525074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.526439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.528004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:22.537678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:22.540782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:22.541695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 510/995] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:22.545282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.594520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb20d3e-0941-4644-ba38-f51b1d3255fd None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.633127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.634269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.634733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.636029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.636951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:22.637438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.639408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.649735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 486/996] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:22.650825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.651020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21c583-f913-4f76-b8c2-7b04804e24dc None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.652730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.663999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.686048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.686695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.686985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.687232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.687871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:22.688446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.690198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.695734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 511/997] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:22.702143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.756669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565509d-af53-464e-a59d-ad0f3a153910 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.792724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.793335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.793613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.793879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.794505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] RBAC: Adding query filter params (type=compute) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:22.794801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.796144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.805907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 487/998] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:22.806939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.816837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f35b0-121f-440a-96f1-a17f3f593a8d None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.855483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.856410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.856897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.857377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.858262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:22.858751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.860331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.865481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 512/999] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:22.871030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.893988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.900347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:22.919599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c916-4b95-4887-8e1a-8c16b887cacd None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:22.959647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:22.960264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:22.960540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:22.960837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:22.961536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] RBAC: Adding query filter params (interface=public, service_id=ec21cdc5c32049038b59f3b7b69cc09b, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:22.961868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:22.963762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:22.973539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 488/1000] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/endpoints?service_id=ec21cdc5c32049038b59f3b7b69cc09b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:22.974560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:22.982907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62a7a-101e-4d5b-a44f-f6be9015fa6e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:23.023633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:23.024298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.024796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.025260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.026895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:23.028228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7e50c-ae5f-498e-98a3-5266276f2679 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:23.077778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4c8f1-cfd2-4bd2-9e02-958bb71fabb9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:23.111325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:23.113168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.113451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.113747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.114362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:23.115836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac8346-7a4f-4178-83b9-f58f6ca82b8c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:23.119221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 513/1001] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:23.128841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 489/1002] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:22 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:35:23.138352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5c1b-1f93-4e5b-83e6-a163639654ad None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.138682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5c1b-1f93-4e5b-83e6-a163639654ad None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.138915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5c1b-1f93-4e5b-83e6-a163639654ad None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.140500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 514/1003] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:23.146966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.147245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.147562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.155554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:23.169546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:23.170815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:23.257893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 490/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:23.532023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5c1b-1f93-4e5b-83e6-a163639654ad None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:23.657049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:23.670860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5c1b-1f93-4e5b-83e6-a163639654ad None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:23.705330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:23.705968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.706247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.706518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] PATH_INFO: `/v3/services/image` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.707163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:23.708537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:23.717195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:23.718208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:23.719071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:23.720910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 515/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 5 10:35:23 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:23.724172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:23.825066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8ec0b-df1f-49f0-8ad6-83ab9a540a1b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:23.850780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:23.859348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:23.860006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:23.860282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:23.860549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:23.861202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] RBAC: Adding query filter params (name=image) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:23.861501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:23.862847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927087c-bbc8-44ae-89b3-6e6e43dd633d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:23.867587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 491/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:23.873653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:23.978580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bfb6-7303-4f97-8eb4-7c5eb2e94a4f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:24.013167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:24.013782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:24.014043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:24.014314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:24.014943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] RBAC: Adding query filter params (type=image) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:24.015243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:24.016632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16f23c-ba29-48a1-8687-fe1852d8b5cb None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:24.021322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 516/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:25.053829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de733c2f-1245-442c-9109-ba4f3efb8b55 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.054340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de733c2f-1245-442c-9109-ba4f3efb8b55 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.054447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de733c2f-1245-442c-9109-ba4f3efb8b55 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.055833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 492/1008] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:25.061271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.061672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.061836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.083840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:25.085225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:25.086243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f924b1-a3ec-4666-a885-21ff15c2b08f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.086535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f924b1-a3ec-4666-a885-21ff15c2b08f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.086812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f924b1-a3ec-4666-a885-21ff15c2b08f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.089453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 493/1009] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:25.094811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.095126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.095366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.098483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:25.114114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:25.115309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:25.161597 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 517/1010] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:25.191756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 494/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:25.431833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.460788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.536469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835807-a16e-4394-bb1d-1647e249f29e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:25.568032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855181-fa6b-4374-ac9a-7b3925a10544 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:25.571598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:25.574695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.574695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.574695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.574695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:25.575723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:25.585091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:25.586141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:25.587048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 518/1012] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:25.592290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.595839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:25.606157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:25.611778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:25.612687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.612799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.614801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.614801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:25.615570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:25.617372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 495/1013] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:25.623192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.696124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef2c6-8d20-45c4-b3a9-3703e5b2fbc1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:25.727413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85495a-72ce-4ede-85ae-513cb11fe8c1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:25.731814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:25.732422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.732728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.732998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.733628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:25.733928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:25.735306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:25.740548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 519/1014] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:25.746488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.769200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:25.769802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.770076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.770369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.770982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:25.772410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:25.822194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:25.843532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 496/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:25 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:25.847462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9144a-c4a6-4c6d-be58-b00d1ddfc5d7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:25.887204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:25.887919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.888275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.888625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.889355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:25.889725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:25.891222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba691b-090e-4ae2-8aba-344b6cccc8d3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:25.897257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 520/1016] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 5 10:35:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:25.902962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:25.937783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360e21-0729-405f-9794-90c6a6b83612 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.938065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360e21-0729-405f-9794-90c6a6b83612 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.938339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64360e21-0729-405f-9794-90c6a6b83612 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.939745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 521/1017] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:25.945282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:25.945560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:25.945829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:25.960481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:25.969264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:25.970492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:26.027703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73331ce-87b5-4bd2-b702-eb1a67ff1026 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:26.049693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 522/1018] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:26.067565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:26.068169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:26.068443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:26.068741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:26.069410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:26.070760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6aadd-491e-49e9-a692-28b8d6449780 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:26.147604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 497/1019] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:26.324364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:26.393485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:26.429492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2998a-c81a-4c36-b0ee-ebdbfb941f61 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:26.472224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:26.473112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:26.473540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:26.473956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:26.474747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:26.476286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0676b-7225-4330-b7da-3f76d6dc8443 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:26.577571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 523/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:26 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:35:27.874377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658399-6dc7-4378-99af-7c124177d9e0 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:27.874903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658399-6dc7-4378-99af-7c124177d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:27.874903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658399-6dc7-4378-99af-7c124177d9e0 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:27.876442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 498/1021] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:27.881427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468ad3-aa67-4754-baad-cae5f39241eb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:27.881808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468ad3-aa67-4754-baad-cae5f39241eb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:27.881987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468ad3-aa67-4754-baad-cae5f39241eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:27.901408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c3468ad3-aa67-4754-baad-cae5f39241eb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:27.902168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c3468ad3-aa67-4754-baad-cae5f39241eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:27.979352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 524/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:28.155876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993514-7c91-4e46-8891-59bb2480b2dc None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.156195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993514-7c91-4e46-8891-59bb2480b2dc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.156427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993514-7c91-4e46-8891-59bb2480b2dc None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.157924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 499/1023] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:28.162835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.163118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.163387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.183511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:28.184721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:28.232225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:28.253782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 525/1024] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:28.254803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48993514-7c91-4e46-8891-59bb2480b2dc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.356940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:28.362229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48993514-7c91-4e46-8891-59bb2480b2dc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:28.396216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:28.396888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.397162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.397434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.406084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:28.406084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8f4f-ff6c-43e2-baf6-eed00237f8e6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:28.406084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 500/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:28.407595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.504484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc319b7-d37d-4f28-8175-cb3afc157135 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.504798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc319b7-d37d-4f28-8175-cb3afc157135 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.505074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc319b7-d37d-4f28-8175-cb3afc157135 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.506411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 501/1026] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:28.508567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74f7b-f908-4605-a310-f85d60eba73a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:28.511377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.511663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.511938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.530665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:28.531859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:28.547195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:28.547801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.548077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.548345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.549038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:28.550491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:28.600403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 502/1027] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:28.601397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.648659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 526/1028] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:35:28 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:28.706750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:28.713973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78264d-22ec-4673-9b72-48b8c0291eac None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:28.752624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:28.753306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.753585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.753925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.766238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:28.771133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:28.772168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:28.773091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 503/1029] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:28.778893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.820186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:28.875115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.890238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d93e3-1320-42e1-a8d5-d2f8f2158624 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:28.927996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:28.928983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:28.929534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:28.929808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:28.930476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:28.930775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:28.933096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:28.942161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 527/1030] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:28.948284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:28.996908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792315-8aaa-451b-991d-118bc3d5503d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.032689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.033325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.033601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.033869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] PATH_INFO: `/v3/services/image` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.034454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.035820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:29.045350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:29.046380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:29.047268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 504/1031] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 5 10:35:28 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:29.052390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.054111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.059846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d5f7-1150-42e7-bf27-0a4ccfdd6b63 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.077195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.097662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.098296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.098568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.098839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.109984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.111426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:29.126758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:29.127744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:29.128776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:29.128776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:29.128776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:29.128776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 528/1032] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:29.133606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.162240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f6dca-486e-4efa-af94-8ba884831714 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.199385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.199996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.200286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.200539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.201201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] RBAC: Adding query filter params (name=image) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:29.201756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.203117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.208257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 505/1033] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:29.213837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.241491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aed166-cc1b-47ae-9c40-b5c17229767a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.278697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.279224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.279497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.279765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.280408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:29.280734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.282119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.297131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 529/1034] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:29.302147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.302420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.314928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.319843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270d889-4d09-4870-a664-3314a725ab5f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.363206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.363809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.364089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.364356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.365023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] RBAC: Adding query filter params (type=image) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:29.365315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.366691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.372034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 506/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:29.377832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.414638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ab56b-83a1-4cf0-891c-21068b5f3728 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.450595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.451588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.451953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.452272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.459321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.460868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:29.472939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:29.474142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:29.475351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:29.480977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 530/1036] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:29.481645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.485136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd69873-286e-4d08-85e7-362c1ffee79b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.520536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.521308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.521693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.522064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.522916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] RBAC: Adding query filter params (interface=public, service_id=2535e884dd0442529a0b75c8998f1ac7, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:29.523300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.524782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.533836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 507/1037] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/endpoints?service_id=2535e884dd0442529a0b75c8998f1ac7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:29.535972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.550582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.551512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.583862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31a8b-f035-4292-8534-b9af508adf50 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.618059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.618931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.619920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.620196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.620961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:29.621259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.622692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.641728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 531/1038] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:29.645921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac15de2-d692-47f0-b9f9-36adce3d4c5e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.647239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:29.689244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.689856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.690135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.690402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.691011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.692370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.700628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 508/1039] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:35:29.769631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e46-efe8-4cc9-b021-b7e3439ca60f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:29.798845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:29.807936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:29.811735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:29.811735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:29.811735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:29.885124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:29.886696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:29.996622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 532/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:35:29.998837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:30.077228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:30.100747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36881557-c28d-46ba-b0c5-0b833fe2d712 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:30.135530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:30.136153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.136424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.136718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.146718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:30.148144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:30.163239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:30.164233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:30.165222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:30.165222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:30.165222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:30.165222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 509/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:30.173372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:30.202457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:30.274494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37518f7-1368-436e-84a7-64d5ad2eace1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:30.308653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:30.309417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.309790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.310157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.310890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:30.311315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:30.312802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:30.324889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 533/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:30.330578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:30.431337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9266cf0-10c5-4f89-8e41-b4ade4c0e1e2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:30.458638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:30.467319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:30.478865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.478865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.478865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.478865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:30.478865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:30.488246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:30.489407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:30.490809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:30.492760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 510/1043] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:30.496339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:30.586504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:30.599437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7463c-4b68-4c1a-9cd3-3ab1badf8caa None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:30.633040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:30.633736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.634095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.634435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.635927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:30.636460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:30.638424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6342-f4c0-449a-8392-cd01623228af None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:30.655713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 534/1044] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:30.657196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:30.678819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509b83-c153-4316-85ff-d7a21e68b02b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.679105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509b83-c153-4316-85ff-d7a21e68b02b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.679382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509b83-c153-4316-85ff-d7a21e68b02b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.680879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 535/1045] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:30.686340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.686598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.686871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.706774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:30.708203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:30.770392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d175e2-96e5-4612-b2b9-8517830965f6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:30.788732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 536/1046] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:30.808944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:30.809762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:30.810248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:30.810769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:30.811691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] RBAC: Adding query filter params (role.id=828a215d857f4a559fa67497b95a5044, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:30.812158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:30.813756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:30.820285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 511/1047] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:30 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=828a215d857f4a559fa67497b95a5044 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:31.059428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:31.139553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:31.161662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9364-ac81-4f80-a766-d0334fd68af8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:31.196269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:31.196925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.197853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.198324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.209037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:31.214518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:31.215489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:31.216379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:31.220572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 537/1048] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:31.221797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:31.279044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:31.325795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694d2-163d-4ec3-adbc-6b814a732bf6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:31.359780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:31.360381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.360693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.360963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.361615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:31.361912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:31.363257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:31.377411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 512/1049] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:31.378814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:31.479353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889ff2-c4f3-44be-8883-231e3785200b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:31.512870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:31.513576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.513919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.514255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] PATH_INFO: `/v3/users/39078238b20e45f6bf54efe854e4d81f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.521565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:31.528937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] RBAC: Authorizing `identity:get_user(user_id=39078238b20e45f6bf54efe854e4d81f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:31.544562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261f33c-4d8f-41e7-a3fc-59d80d5ff7ad None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:31.544562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 538/1050] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:31 2022] GET /identity/v3/users/39078238b20e45f6bf54efe854e4d81f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:31.544771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:31.641675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2baa0b-cff5-4654-87f2-d19b3701d4e9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:31.656400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:31.677138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:31.677828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.678171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.678650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.680416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a74b-8c3c-4327-8870-364f34e4f281 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.680893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a74b-8c3c-4327-8870-364f34e4f281 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.681327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a74b-8c3c-4327-8870-364f34e4f281 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.683215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 539/1051] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:31.688146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:31.688422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:31.688721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:31.708533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:31.709745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:31.757877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:31.759363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:31.792793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 540/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:31.867080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 513/1053] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:31.873212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:31.983770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2aaa3-0491-4380-8251-ad382b824857 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.011046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:32.019577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.030046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 541/1054] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:31 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:32.032255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:32.048255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:32.068817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:32.141387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee1174-5e26-48c2-be09-55f61a023c24 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.173843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e19e2-e743-4c49-91fe-59d26629955b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.179929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.180539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.180847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.181124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.182416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=2da475de57d045bc96164bfecb40b076, user.id=39078238b20e45f6bf54efe854e4d81f) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:32.182803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.184243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.200621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 514/1055] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:32 2022] GET /identity/v3/role_assignments?user.id=39078238b20e45f6bf54efe854e4d81f&scope.project.id=2da475de57d045bc96164bfecb40b076&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:32.227772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.228518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.229002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.229323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.229919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.231324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:32.241310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:32.242427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:32.245714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 542/1056] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 5 10:35:32 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:32.250588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:32.339753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:32.362402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc2709-5c5b-48fe-8f28-4188a742b747 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.398008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.398620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.398896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.399167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.399800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] RBAC: Adding query filter params (name=image) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:32.400098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.401712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.411203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 515/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:32.412363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:32.473084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:32.515439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc12c-dc51-4317-8ad0-622daaafe8d4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.549766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.550377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.550653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.550926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.551546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] RBAC: Adding query filter params (type=image) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:32.551843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.553320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23981a4-550c-4b8c-a963-660806bc49ad None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.563815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 543/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:32.565414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:32.672320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a64b-6512-43d2-a85a-ae80a99b6627 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:32.709047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:32.709656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.709930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.710197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.710878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:32.712239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:32.732520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cc27-4478-40b3-acff-25a74d3c1bfd None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.732834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cc27-4478-40b3-acff-25a74d3c1bfd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.733139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cc27-4478-40b3-acff-25a74d3c1bfd None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.734505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 544/1059] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:32.739645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:32.739927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:32.741016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:32.764282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:32.765533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:32.776420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:32.783221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 516/1060] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:35:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:32.860642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 545/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:33.130869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:33.244732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872a59-4d89-43b2-a810-c446fa893590 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:33.285250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:33.285912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:33.286153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:33.286423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:33.297728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:33.303709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:33.305217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:33.306582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 517/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:33.312646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:33.372201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:33.438312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe19f7-af83-4f2c-b220-24e3a355cbfb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:33.480804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:33.480804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:33.480804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:33.480804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:33.481247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:33.481247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:33.482598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:33.497842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 546/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:33.498925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:33.558535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:33.602164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921d2a-93a9-4a00-9ba7-34aa50fbef6c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:33.638405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:33.639036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:33.639314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:33.639582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:33.651325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:33.652850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:33.667564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:33.668621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:33.669657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:33.669657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:33.669657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:33.669657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 518/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:33.675957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:33.780968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529abd-cced-40f2-bbc2-c694adb8f13a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:33.791484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:33.817234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:33.817884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:33.818202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:33.818563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:33.819249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:33.819588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:33.821032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:33.834957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 547/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:33.839735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:33.943035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b310167-8691-4343-bd02-165dbabc457f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:33.961018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:33.986350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:33.986984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:33.987262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:33.987532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:33.996566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:33.998025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:34.009123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:34.010902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:34.017025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 519/1066] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:35:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:34.018959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.122839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205f0d-ca30-4a13-8b9a-b3768ff1a36c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.156918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.157583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.157865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.158132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.158914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:34.159218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.160661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfacb6-f9fc-440f-b3c2-22120ef2a133 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.183617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 548/1067] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:34.185394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.186027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeab0f-8421-4277-b706-a3ae3b65fa67 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.186311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeab0f-8421-4277-b706-a3ae3b65fa67 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.186638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeab0f-8421-4277-b706-a3ae3b65fa67 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.188115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 549/1068] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:35:34.192835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.193116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.193388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.213478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:34.214671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:34.240315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:34.286789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 550/1069] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:34.295799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7c3b2-e1fd-4c28-b727-41fbcd99404f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.331681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.332307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.332597 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.332877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.343583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.345040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:34.359763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:34.361021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:34.361982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:34.361982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:34.361982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:34.364896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 520/1070] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:34.366758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.467598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e988c2-b625-453f-9bcc-d6d9399416b1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.503430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.504041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.504319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.504610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.505256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:34.505556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.506922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.522628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 551/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:34.523836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.549945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:34.554810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.575883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:34.632367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce8cc-4651-4729-8cf8-821404d629a8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.660615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0df2b-d106-4246-bcbd-ba89545f656e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.668949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.669580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.669855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.670123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.676937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.678375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:34.690034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:34.690965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:34.691885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:34.695911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 521/1072] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:34.696762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.697921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.698558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.698838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.699111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.709864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:34.715754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:34.716803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:34.717721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 552/1073] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:34.722661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.787819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:34.806794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:34.812040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2310-edc0-4443-af2a-91548c5d8592 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.827892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8a180-5966-4944-9c76-d9bff623ac25 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:34.846495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.847102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.847376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.847639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.848340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:34.848719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.850131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8389-b905-4634-94f4-a9ab89b02a9a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.862574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:34.862862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 522/1074] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:34.863184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.863463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.863736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.864041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6fb9a-1a7d-41d7-a193-76e42669b53f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.864321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6fb9a-1a7d-41d7-a193-76e42669b53f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.864420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:34.864611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6fb9a-1a7d-41d7-a193-76e42669b53f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.864722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:34.865964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 523/1075] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:34.866080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501d498-682a-4d65-a80f-eafcb2f20a17 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:34.869806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6fb9a-1a7d-41d7-a193-76e42669b53f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.875186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 553/1076] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:34.876332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a172d-0670-4796-9920-be08988a91cd None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:34.876639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a172d-0670-4796-9920-be08988a91cd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:34.876922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a172d-0670-4796-9920-be08988a91cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:34.895087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e84a172d-0670-4796-9920-be08988a91cd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:34.896266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e84a172d-0670-4796-9920-be08988a91cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:34.968845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 554/1077] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:34.969626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a172d-0670-4796-9920-be08988a91cd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:34.974011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6fb9a-1a7d-41d7-a193-76e42669b53f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.012605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.013360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.013705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.014062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/828a215d857f4a559fa67497b95a5044` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.016446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=a69da51c538a4e29ac81a774c36c4931, role_id=828a215d857f4a559fa67497b95a5044)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.017778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.039126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.067836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a172d-0670-4796-9920-be08988a91cd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.093481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 524/1078] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:35:34 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/a69da51c538a4e29ac81a774c36c4931/roles/828a215d857f4a559fa67497b95a5044 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:35:35.102100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.102942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.103307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.104094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] PATH_INFO: `/v3/users/39078238b20e45f6bf54efe854e4d81f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.105787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] RBAC: Authorizing `identity:get_user(user_id=39078238b20e45f6bf54efe854e4d81f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.107992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.116058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 555/1079] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:34 2022] GET /identity/v3/users/39078238b20e45f6bf54efe854e4d81f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:35.116606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:35.120321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.232693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eae21-b49f-4443-b6af-4bd5ed8f6720 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.239828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:35.272367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.273036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.273313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.273583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.274718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.277011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.278651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 525/1080] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:35 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:35.284874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:35.354790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.359594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e6ae3-9dd9-480f-a926-cbb6c111c170 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.387051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f96a-ae25-483e-bcec-8a08b1676672 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.396147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.397310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.397737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.398153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.407373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.425201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.425853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.426131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.436459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076/users/39078238b20e45f6bf54efe854e4d81f/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.436459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] RBAC: Authorizing `identity:create_grant(project_id=2da475de57d045bc96164bfecb40b076, user_id=39078238b20e45f6bf54efe854e4d81f, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.436459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.467725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.469227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.520022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 526/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:35:35 2022] PUT /identity/v3/projects/2da475de57d045bc96164bfecb40b076/users/39078238b20e45f6bf54efe854e4d81f/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:35:35.576642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 556/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:35.581639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:35.718706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b159a-5f21-46b9-a9da-2b79424b951d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.748334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.754734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.755370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.755648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.755918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.766990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.768433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-13938d3b-f903-4d8e-b7ed-d2ff42879ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:35.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:35.783415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:35.784341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:35.784341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:35.784341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:35.784341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 527/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:35.789354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:35.830358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:35.890149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6aa6-6db9-4e7a-a8c9-22f31ac5fd70 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:35.924308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:35.925094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:35.925488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:35.925851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:35.926588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:35.926988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:35.928460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e5dd-2153-41cc-8b69-db063c69abd5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:35.940449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 557/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:37.088629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2a26-4abe-46f4-aac8-eb793f46f6ec None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.089263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2a26-4abe-46f4-aac8-eb793f46f6ec None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.089263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b2a26-4abe-46f4-aac8-eb793f46f6ec None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.090706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 528/1085] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:37.096631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f3f3-d4d7-4d7c-90c9-67515dfe8579 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.097150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f3f3-d4d7-4d7c-90c9-67515dfe8579 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.097150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f3f3-d4d7-4d7c-90c9-67515dfe8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.115914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-56f5f3f3-d4d7-4d7c-90c9-67515dfe8579 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:37.117129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-56f5f3f3-d4d7-4d7c-90c9-67515dfe8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:37.184679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 558/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:37.434331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b39f8-a16b-41c5-8d78-a597d9970424 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.434615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b39f8-a16b-41c5-8d78-a597d9970424 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.434883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b39f8-a16b-41c5-8d78-a597d9970424 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.436213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 529/1087] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:37.441357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.441642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.441910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.452128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b39f8-a16b-41c5-8d78-a597d9970424 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:37.460037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:37.461234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:37.483875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:37.527102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 559/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:37.553618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b39f8-a16b-41c5-8d78-a597d9970424 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:37.586160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:37.586789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.587063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.587329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.598227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:37.603020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:37.604687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:37.605633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 530/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:37.610779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:37.706949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87884ec-0acc-4217-a33c-e9f650e0884c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:37.740052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:37.740690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.740966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.741237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.741884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:37.742178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:37.743533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:37.751157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 560/1090] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:37.756724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:37.798196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:37.801278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:37.820090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:37.861737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155345c-a972-4353-ab93-60c6179a7f78 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:37.894520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:37.895148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.895424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.895693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.897644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f266550-1ea0-4774-ae43-522d8a5b4c6f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:37.906476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:37.907902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:37.922425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:37.923432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:37.924377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:37.924377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:37.924377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:37.924377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 531/1091] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:37.929291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:37.935618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:37.936248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:37.936523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:37.936824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:37.947361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:37.952643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:37.953661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:37.955034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 561/1092] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:37.961894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.028685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.035110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a16bb-7928-4e83-8557-5f8ae5cd9d59 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.043807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.062641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd772063-ae60-4d8e-8476-3f83ad4b53f9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.068554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.072963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.084617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 532/1093] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:38.091036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.097821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.098436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.098720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.098991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.099664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:38.099965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.101371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.109495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 562/1094] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:38.115166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.189910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f1a3-1aab-4c4b-9a62-4e9407b2ad22 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.215624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600ea8-cde5-4f1a-ab73-2441205075a4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.225076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.225725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.225999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.226271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.233097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.234522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:35:38.246010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:38.247010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:38.248014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 533/1095] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:35:38.248700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.248700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.249058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.249169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] PATH_INFO: `/v3/users/39078238b20e45f6bf54efe854e4d81f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.250319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=39078238b20e45f6bf54efe854e4d81f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.251962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.252824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.253596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 563/1096] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/users/39078238b20e45f6bf54efe854e4d81f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:38.258970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.268860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.272106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.353609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f58f6-a1c9-4a8c-b116-a469a0b4f66d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.358904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855198-806f-42b9-bee3-cdf46dbce0f5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.388150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.388780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.389062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.389333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.390065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:38.390374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.391794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.392817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.393419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.393693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.393960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.408462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 534/1097] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:38.414226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.460509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.461984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.474010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.482648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.512218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226d92a-056e-4b7d-8d43-883782b0810c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.545525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.546124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.546491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.546755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.561590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 564/1098] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:35:38.567435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.613858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.615354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.664461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959692-8364-4294-a57a-41b618e7c899 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.675511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.686461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:38.698922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.699547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.699825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.700090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.701232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.702916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.704548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 565/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:38.710566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.716985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 535/1100] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:35:38.722877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.811161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7082-4817-43d7-a61f-9b48d4667c85 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.820217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a82fc-189d-4c7e-8922-3ce78ba95917 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:38.844727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.845357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.845636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.845910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.846650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=2da475de57d045bc96164bfecb40b076, user.id=39078238b20e45f6bf54efe854e4d81f) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:38.846958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.848390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.854815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:38.868618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 566/1101] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/role_assignments?user.id=39078238b20e45f6bf54efe854e4d81f&scope.project.id=2da475de57d045bc96164bfecb40b076&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:35:38.869373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:38.869373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:38.869373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:38.869373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:38.869373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:35:38.886073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:38.887321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:35:38.888533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:35:38.888533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:35:38.888533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:38.892123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 536/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:38.893427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:38.940043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:39.001010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977b909-6c7b-4b45-9411-2c3bfa82a561 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:39.035961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:39.036563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:39.036881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:39.037151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:39.037782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:39.038083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:39.039474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:39.052795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 567/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:39.059444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:39.085803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:39.159753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f1da0-ea23-4860-aa17-537d3afff6a3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:39.192963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:39.193587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:39.193860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:39.194128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:39.200759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:39.202444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:35:39.213954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:39.215051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:35:39.216008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 537/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:39.220902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:39.320126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28db9e3-0622-42d5-b505-056599584e90 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:39.322325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:39.354357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:39.354891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:39.355168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:39.355436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:39.356121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:39.356423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:39.357893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fd821-4eb5-4d44-b34e-6367342063bb None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:39.369657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 568/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:39.375672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:39.464235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:39.480616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe38f98-4bb2-4d8b-88e1-28892fd853ef None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:39.513784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:39.514383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:39.514657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:39.514929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:39.515643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] RBAC: Adding query filter params (role.id=828a215d857f4a559fa67497b95a5044, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=a69da51c538a4e29ac81a774c36c4931) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:39.515944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:39.517384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67f7a-7925-4deb-87d4-9c96e043f7d4 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:39.523017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 538/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:39 2022] GET /identity/v3/role_assignments?user.id=a69da51c538a4e29ac81a774c36c4931&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=828a215d857f4a559fa67497b95a5044 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:40.787321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9394c-19dc-4f77-937b-5f58936fbcb0 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:40.787825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9394c-19dc-4f77-937b-5f58936fbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:40.787825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9394c-19dc-4f77-937b-5f58936fbcb0 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:40.789149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 569/1107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:40.794937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:40.795329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:40.795484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:40.813628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:40.814805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:40.881118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 539/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:41.158219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9394c-19dc-4f77-937b-5f58936fbcb0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:41.256283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9394c-19dc-4f77-937b-5f58936fbcb0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:41.289449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:41.290058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:41.290357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:41.290693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:41.291945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:41.293402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe94d-5580-42d0-bc1e-d44020ad1845 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:41.294941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 570/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:41.300516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:41.376541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:41.397810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df652f8-a33a-471f-b6e6-f11327bdce06 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:41.431503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:41.432053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:41.432331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:41.432620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:41.433278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:41.434689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f662b12-0e28-4974-ab52-ec48579400c2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:41.520909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 540/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:35:41 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:43.459677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55320-ef64-4d85-bc79-f1c948923f38 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:43.460213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55320-ef64-4d85-bc79-f1c948923f38 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:43.460213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55320-ef64-4d85-bc79-f1c948923f38 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:43.461588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 571/1111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:43.467358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:43.467756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:43.467898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:43.486147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:43.487311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:43.550994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 541/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:43.819220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c55320-ef64-4d85-bc79-f1c948923f38 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:43.848817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:43.917594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c55320-ef64-4d85-bc79-f1c948923f38 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:43.949835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:43.950444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:43.950723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:43.950991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] PATH_INFO: `/v3/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:43.952648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] RBAC: Authorizing `identity:get_role(role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:43.954025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:43.955547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 572/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:43 2022] GET /identity/v3/roles/475895c891594cd884efae065d6f7da7 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:43.961115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:44.021118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:44.059110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c78d-f2d6-4125-b159-eae6cebcc9db None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:44.092730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:44.093441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:44.094173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:44.094447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] PATH_INFO: `/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:44.107809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] RBAC: Authorizing `identity:get_user(user_id=f9bdf6b394724fb4a58ab1e0c6cb42f5)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:44.109258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:44.110845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 542/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:43 2022] GET /identity/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:44.116884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:44.211699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:44.215509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc45649-a1b8-4e5c-997a-f5e84389a2b4 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:44.248486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:44.249106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:44.249381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:44.249647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:44.313558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:44.314993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:44.405495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:44.409763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 573/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:44.416539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:44.511235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1d0e-fba8-43a2-bc9e-608a2b96a719 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:44.533122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:44.544357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:44.545010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:44.545286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:44.545552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:44.546646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:44.548057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db535aa6-e499-44da-b42a-143b7c7b458d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:44.549686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 543/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:44 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:44.555861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:44.650133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180469a2-c983-44d0-908b-da9f7473a96f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:44.682876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:44.683408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:44.683681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:44.683947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:44.684682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=2da475de57d045bc96164bfecb40b076, user.id=f9bdf6b394724fb4a58ab1e0c6cb42f5) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:44.684984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:44.686399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69278833-3d94-4ece-ba84-6677332f1886 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:44.691563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 574/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:44 2022] GET /identity/v3/role_assignments?user.id=f9bdf6b394724fb4a58ab1e0c6cb42f5&scope.project.id=2da475de57d045bc96164bfecb40b076&role.id=475895c891594cd884efae065d6f7da7 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:46.545289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b1b1c-7455-4b5d-bc36-6b8752f104fd None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:46.545818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b1b1c-7455-4b5d-bc36-6b8752f104fd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:46.545818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b1b1c-7455-4b5d-bc36-6b8752f104fd None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:46.547161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 544/1118] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:46.552203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:46.552651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:46.554724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:46.571320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:46.573121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:46.627128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:46.637562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 575/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:46.907760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b1b1c-7455-4b5d-bc36-6b8752f104fd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:47.007322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b1b1c-7455-4b5d-bc36-6b8752f104fd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:47.039446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:47.040611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:47.040888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:47.041158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] PATH_INFO: `/v3/roles/475895c891594cd884efae065d6f7da7` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:47.042530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] RBAC: Authorizing `identity:get_role(role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:47.043875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:47.045199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 545/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:46 2022] GET /identity/v3/roles/475895c891594cd884efae065d6f7da7 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:47.051149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:47.148236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc642ea5-dff5-4bf5-ae92-271a3ce4e965 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:47.181796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:47.182386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:47.182667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:47.182941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] PATH_INFO: `/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:47.184055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] RBAC: Authorizing `identity:get_user(user_id=f9bdf6b394724fb4a58ab1e0c6cb42f5)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:47.185520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:47.187132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 576/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:47 2022] GET /identity/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:47.193040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:47.250168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:47.289705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c624025-55bf-42fe-b7e5-cfd554d517b5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:47.323409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:47.324293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:47.324569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:47.324868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:47.325980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:47.327669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371f26c-de1e-4ec9-80ed-580c9434b9e8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:47.329299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 546/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:47 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:47.335158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:47.393267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:47.432254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247681-006a-4050-abea-d89373fd42a2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:47.464682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:47.465324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:47.465597 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:47.465861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076/users/f9bdf6b394724fb4a58ab1e0c6cb42f5/roles/475895c891594cd884efae065d6f7da7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:47.467951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2da475de57d045bc96164bfecb40b076, user_id=f9bdf6b394724fb4a58ab1e0c6cb42f5, role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:47.469417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bb7bd-9fc0-4e48-9572-08b00872ebd7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:47.586830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 577/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:35:47 2022] PUT /identity/v3/projects/2da475de57d045bc96164bfecb40b076/users/f9bdf6b394724fb4a58ab1e0c6cb42f5/roles/475895c891594cd884efae065d6f7da7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:35:49.446599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde4ae-6e00-4204-9653-3f872ce7b79e None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:49.447150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde4ae-6e00-4204-9653-3f872ce7b79e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:49.447150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbde4ae-6e00-4204-9653-3f872ce7b79e None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:49.448504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 547/1124] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:49.453875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:49.454278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:49.454446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:49.472639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:49.473831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:49.538280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 578/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:35:49.804781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbde4ae-6e00-4204-9653-3f872ce7b79e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:49.907450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbde4ae-6e00-4204-9653-3f872ce7b79e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:49.933406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:49.941805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:49.942425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:49.947451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:49.947451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] PATH_INFO: `/v3/roles/475895c891594cd884efae065d6f7da7` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:49.947451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] RBAC: Authorizing `identity:get_role(role_id=475895c891594cd884efae065d6f7da7)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:49.947451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:49.948125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 548/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:49 2022] GET /identity/v3/roles/475895c891594cd884efae065d6f7da7 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:49.954392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:50.004359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:50.052573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34d1a-0ec1-49b0-b3be-93420177b364 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:50.086187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:50.086744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:50.087586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:50.087921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] PATH_INFO: `/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:50.089079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] RBAC: Authorizing `identity:get_user(user_id=f9bdf6b394724fb4a58ab1e0c6cb42f5)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:50.090498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:50.092092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 579/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:49 2022] GET /identity/v3/users/f9bdf6b394724fb4a58ab1e0c6cb42f5 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:50.097757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:50.193824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8309c9-aba9-4afa-bbac-3a76954127b5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:50.227842 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:50.228503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:50.228809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:50.229072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:50.285997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:50.293105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:50.294530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:50.389737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 549/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:50.395682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:50.493522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7ad9-5b32-4824-a7fa-b1fc05c6b82b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:50.510226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:50.526838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:50.527457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:50.527732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:50.528002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] PATH_INFO: `/v3/projects/2da475de57d045bc96164bfecb40b076` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:50.529131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] RBAC: Authorizing `identity:get_project(project_id=2da475de57d045bc96164bfecb40b076)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:50.530566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e27646-8034-4c77-aba2-8feb8040c174 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:50.532178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 580/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:50 2022] GET /identity/v3/projects/2da475de57d045bc96164bfecb40b076 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:50.538462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:50.632973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:50.645121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f3929-41c3-4faf-9c8a-6f76dcde7fa1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:50.680274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:50.681618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:50.681895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:50.682164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:50.682890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] RBAC: Adding query filter params (role.id=475895c891594cd884efae065d6f7da7, scope.project.id=2da475de57d045bc96164bfecb40b076, user.id=f9bdf6b394724fb4a58ab1e0c6cb42f5) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:50.683197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:50.684624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f61f7-0cea-42b2-96e5-e7cdce92de83 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:50.690239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 550/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:50 2022] GET /identity/v3/role_assignments?user.id=f9bdf6b394724fb4a58ab1e0c6cb42f5&scope.project.id=2da475de57d045bc96164bfecb40b076&role.id=475895c891594cd884efae065d6f7da7 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:52.607083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ae0d-8f88-4ca2-b6a6-5a8119452684 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:52.607636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ae0d-8f88-4ca2-b6a6-5a8119452684 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:52.607636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1ae0d-8f88-4ca2-b6a6-5a8119452684 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:52.608995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 581/1131] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:52.614292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:52.614730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:52.614861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:52.633281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:52.634852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:52.700794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 551/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:52.982867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1ae0d-8f88-4ca2-b6a6-5a8119452684 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:53.080089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1ae0d-8f88-4ca2-b6a6-5a8119452684 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:53.112685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:53.113297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:53.113572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:53.113838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:53.114930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:53.116359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f306b-5894-4735-921b-cd647b358e5d None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:53.118063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 582/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:53.123631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:53.208840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:53.220521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7de9a-1a41-4340-9f1e-6963c31461ca None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:53.252645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:53.253237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:53.253513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:53.253778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:53.254411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:53.255814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986157a-a2e4-48d0-80c5-1d02b32217d7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:53.346676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 552/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:35:53 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:55.276833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7462-3331-48cb-8508-a056dc177155 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:55.277331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7462-3331-48cb-8508-a056dc177155 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:55.277331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7462-3331-48cb-8508-a056dc177155 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:55.278649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 583/1135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:55.283827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:55.284224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:55.284368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:55.302819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:55.303989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:55.369395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 553/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:55.638490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc7462-3331-48cb-8508-a056dc177155 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:55.693504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:55.736860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc7462-3331-48cb-8508-a056dc177155 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:55.769563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:55.770178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:55.770452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:55.770724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:55.771814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:55.773274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee5e57-fd10-4666-942b-07fd819c2371 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:55.775528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 584/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:55.781496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:55.850590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:55.879781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352675b-ee70-451c-aeb3-fc3d432de5de None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:55.912604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:55.913215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:55.913491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:55.913760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:55.914399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:55.916435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e363635-cb58-4a88-9fdc-a6676178b9d5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:56.037749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 554/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:35:55 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:35:57.967920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9b56-785a-4930-b967-36d4af5e508a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:57.968415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9b56-785a-4930-b967-36d4af5e508a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:57.968524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f9b56-785a-4930-b967-36d4af5e508a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:57.969842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 585/1139] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:35:57.974985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:57.975398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:57.975519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:57.993969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:35:57.995144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:35:58.058912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 555/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:35:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:35:58.328732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f9b56-785a-4930-b967-36d4af5e508a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:58.426274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f9b56-785a-4930-b967-36d4af5e508a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:58.448578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:58.459727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:58.460344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:58.460697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:58.466633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:58.471119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:35:58.475889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:35:58.477105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:35:58.478281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 586/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:35:58.483228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:58.537708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:58.580902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a0293-7355-46b2-a0da-a3a91da4164c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:58.613162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:58.613751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:58.614026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:58.614290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:58.614940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:58.615235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:58.616582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:58.624732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 556/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:58.630615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:58.727938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109be51-baf5-4dcd-9bcf-05b745bc7cb1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:58.761775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:58.762392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:58.762669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:58.762937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] PATH_INFO: `/v3/users/a06282fede5e4b8ca457989287012645` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:58.776483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] RBAC: Authorizing `identity:get_user(user_id=a06282fede5e4b8ca457989287012645)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:58.777955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:58.779546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 587/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:35:58 2022] GET /identity/v3/users/a06282fede5e4b8ca457989287012645 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:58.785452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:58.882603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7480-e0a7-49eb-8841-7a77eaeaba28 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:58.899582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:58.916025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:58.916642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:58.916919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:58.917186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:58.981978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:58.983404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:59.077362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 557/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:35:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:35:59.083324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:59.124478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:59.179515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4539f-517b-492a-8ecf-cfe0a0abd935 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:59.212828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:59.213446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:59.213720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:59.213988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] PATH_INFO: `/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:59.215085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] RBAC: Authorizing `identity:get_project(project_id=aab12d34a0bd423b9b68f0a9a71426b1)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:59.216513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5d9e9-5edb-4989-bb73-c55efb4d2d9e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:59.218141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 588/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:35:59 2022] GET /identity/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:35:59.224096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:35:59.242116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:59.322161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51225dfa-7e4c-41f2-b391-6fef46e1351d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:35:59.356491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:35:59.357115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:35:59.357390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:35:59.357660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:35:59.358373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=aab12d34a0bd423b9b68f0a9a71426b1, user.id=a06282fede5e4b8ca457989287012645) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:35:59.358676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:35:59.360085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bd65c-fe59-489b-af58-760d2ab4ce06 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:35:59.365275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 558/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:35:59 2022] GET /identity/v3/role_assignments?user.id=a06282fede5e4b8ca457989287012645&scope.project.id=aab12d34a0bd423b9b68f0a9a71426b1&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:01.221542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46218-5fd9-4faa-a8f5-ead9544a2ab7 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:01.222047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46218-5fd9-4faa-a8f5-ead9544a2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:01.222047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b46218-5fd9-4faa-a8f5-ead9544a2ab7 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:01.223332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 589/1147] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:01.228516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:01.228927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:01.229083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:01.246767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:01.247935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:01.311748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 559/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:01.578574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b46218-5fd9-4faa-a8f5-ead9544a2ab7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:01.677236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b46218-5fd9-4faa-a8f5-ead9544a2ab7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:01.687529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:01.712574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:01.713213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:01.713528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:01.713797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:01.723441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:36:01.729052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:01.730203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:36:01.731353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 590/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:36:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:01.736343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:01.750464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:01.831190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd29bc-737c-42e6-93ed-f4e7b7a61251 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:01.863056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:01.863653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:01.863924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:01.864189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:01.864862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:01.865157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:01.866493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:01.874839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 560/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:01.880662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:01.989109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553d6e-cf5f-4275-930d-d2ff42f874e9 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:02.023139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:02.023784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:02.024480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:02.024788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] PATH_INFO: `/v3/users/a06282fede5e4b8ca457989287012645` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:02.025937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] RBAC: Authorizing `identity:get_user(user_id=a06282fede5e4b8ca457989287012645)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:02.027381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:02.029074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 591/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:36:01 2022] GET /identity/v3/users/a06282fede5e4b8ca457989287012645 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:02.034869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:02.108970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:02.132686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10d57-55da-407c-af40-b1a60d76b3bb None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:02.165676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:02.166284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:02.166563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:02.166835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] PATH_INFO: `/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:02.167938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] RBAC: Authorizing `identity:get_project(project_id=aab12d34a0bd423b9b68f0a9a71426b1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:02.169385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d55a39-62e0-4755-a049-cb29f0247897 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:02.170985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 561/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:36:02 2022] GET /identity/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:02.176837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:02.211518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:02.272061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b4ee-253a-4b83-8204-f3b04d0c584a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:02.304299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:02.305499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:02.305766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:02.306032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] PATH_INFO: `/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1/users/a06282fede5e4b8ca457989287012645/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:02.307885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] RBAC: Authorizing `identity:create_grant(project_id=aab12d34a0bd423b9b68f0a9a71426b1, user_id=a06282fede5e4b8ca457989287012645, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:02.309330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7f6f2-58ef-4125-8c19-dd5608ee4882 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:02.449505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 592/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:36:02 2022] PUT /identity/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1/users/a06282fede5e4b8ca457989287012645/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:36:04.331490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ae12-f6b8-4d14-a8c6-dd82ba4ab4a7 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:04.331991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ae12-f6b8-4d14-a8c6-dd82ba4ab4a7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:04.331991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ae12-f6b8-4d14-a8c6-dd82ba4ab4a7 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:04.333321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 562/1154] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:04.338443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:04.338836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:04.338985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:04.357526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:04.358705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:04.422712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 593/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:04.697422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ae12-f6b8-4d14-a8c6-dd82ba4ab4a7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:04.800956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ae12-f6b8-4d14-a8c6-dd82ba4ab4a7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:04.833850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:04.834464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:04.834743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:04.835013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:04.845845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:36:04.850664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:04.852684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:36:04.854079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 563/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:04.858440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:04.885050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:04.954226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab0f2-7f40-4158-b31c-0747f74adaf0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:04.988333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:04.988960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:04.989234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:04.989500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:04.990147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:04.990444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:04.991816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:05.000207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 594/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:05.006192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:05.009635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:05.111739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558757-5ced-4c39-9cfe-772db8dd29c6 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:05.144672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:05.145288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:05.145566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:05.145835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] PATH_INFO: `/v3/users/a06282fede5e4b8ca457989287012645` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:05.146945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] RBAC: Authorizing `identity:get_user(user_id=a06282fede5e4b8ca457989287012645)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:05.148354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:05.150462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 564/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:36:05 2022] GET /identity/v3/users/a06282fede5e4b8ca457989287012645 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:05.156320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:05.242307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:05.254279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8857-ea66-4e71-98f5-13b9b3cb9b1e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:05.286889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:05.287476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:05.287749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:05.288012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:05.353554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:05.354988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:05.438870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:05.450760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 595/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:36:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:36:05.457047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:05.529875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:05.559847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371718b9-c303-4eeb-ae89-823459c2540d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:05.592655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:05.593271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:05.593546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:05.593817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] PATH_INFO: `/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:05.594914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] RBAC: Authorizing `identity:get_project(project_id=aab12d34a0bd423b9b68f0a9a71426b1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:05.596361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0790c-521f-4a83-8794-d73c4e47e938 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:05.597995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 565/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:36:05 2022] GET /identity/v3/projects/aab12d34a0bd423b9b68f0a9a71426b1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:05.605004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:05.701006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3176b-da3c-436b-90c3-b4ac290873f8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:05.734457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:05.735049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:05.735327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:05.735599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:05.736314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=aab12d34a0bd423b9b68f0a9a71426b1, user.id=a06282fede5e4b8ca457989287012645) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:05.736640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:05.738057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3e73d-a5b3-4002-8f40-ab9f883a280e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:05.743891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 596/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:36:05 2022] GET /identity/v3/role_assignments?user.id=a06282fede5e4b8ca457989287012645&scope.project.id=aab12d34a0bd423b9b68f0a9a71426b1&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:07.664807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ee5-e014-42c9-8128-68a561b0f45f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:07.665373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ee5-e014-42c9-8128-68a561b0f45f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:07.665373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ee5-e014-42c9-8128-68a561b0f45f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:07.667537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 566/1162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:07.672791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:07.673206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:07.673321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:07.691772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:07.692995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:07.738628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:07.758373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 597/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:08.033204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7ee5-e014-42c9-8128-68a561b0f45f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:08.134096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7ee5-e014-42c9-8128-68a561b0f45f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:08.166437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:08.167021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:08.167291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:08.167556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:08.175510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:08.232329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:08.233724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:08.327543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 567/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:36:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:36:08.333388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:08.428891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1097ad-9d13-4080-a085-37933a84cbc2 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:08.463121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:08.463735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:08.464008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:08.464273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:08.470991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:08.472443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-aa307f76-f6a1-4a1f-96e3-e2405cb76102 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:08.483917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:08.485068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:36:08.486324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 598/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:36:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:08.490935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:08.529721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:08.587137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116743-fb80-4378-b326-06d20af7c883 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:08.619538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:08.620127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:08.620400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:08.620694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:08.621324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:08.621620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:08.622959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee726c-8cad-43fe-86d7-a2ae9b80e461 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:08.629770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 568/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 5 10:36:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:10.510203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea899a9-5e63-401f-8ec5-7731e837e52a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:10.510766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea899a9-5e63-401f-8ec5-7731e837e52a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:10.510766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea899a9-5e63-401f-8ec5-7731e837e52a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:10.512088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 599/1167] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:10.517207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0ad8-d45b-4e18-80e8-b9f861d363b6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:10.517602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0ad8-d45b-4e18-80e8-b9f861d363b6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:10.517748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff0ad8-d45b-4e18-80e8-b9f861d363b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:10.536432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dfff0ad8-d45b-4e18-80e8-b9f861d363b6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:10.537636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dfff0ad8-d45b-4e18-80e8-b9f861d363b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:10.603662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 569/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:36:10.874890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea899a9-5e63-401f-8ec5-7731e837e52a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:10.918715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:10.977290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea899a9-5e63-401f-8ec5-7731e837e52a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:11.009961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:11.010580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:11.010865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:11.011139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:11.011805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:11.013207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445fa35-747b-4be7-97c4-298ed1833ff4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:11.152565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 600/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Sep 5 10:36:10 2022] POST /identity/v3/domains => generated 267 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:36:13.064692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316425-c1e7-45f3-a027-6c4c17381273 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:13.065219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316425-c1e7-45f3-a027-6c4c17381273 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:13.065219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316425-c1e7-45f3-a027-6c4c17381273 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:13.066563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 570/1170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:13.072374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:13.072827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:13.072942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:13.091165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:13.092340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:13.156756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 601/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:36:13.426509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316425-c1e7-45f3-a027-6c4c17381273 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:13.457428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:13.526475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316425-c1e7-45f3-a027-6c4c17381273 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:13.560031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:13.560669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:13.560945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:13.561212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] PATH_INFO: `/v3/domains/8aae4b664e8f49498dbfce0a82c14f6a` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:13.571135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=8aae4b664e8f49498dbfce0a82c14f6a)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:13.572543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65787569-b2ed-4a8d-a493-58c5abe7ff4e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:13.574127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 571/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 5 10:36:13 2022] GET /identity/v3/domains/8aae4b664e8f49498dbfce0a82c14f6a => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:13.580183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:13.610843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:13.677115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ec00-b90a-4e1a-a9bc-4c80c87f6945 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:13.709848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:13.710446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:13.711274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:13.711637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:13.712292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:13.713753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bebf4-ecf3-4c55-9aac-796f0b83bbdf None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:13.786154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 602/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:36:13 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:36:15.689615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c794-53f1-4123-8373-cc0a43050baa None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:15.690166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c794-53f1-4123-8373-cc0a43050baa None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:15.690166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c794-53f1-4123-8373-cc0a43050baa None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:15.691477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 572/1174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:15.696674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:15.697058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:15.697222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:15.715316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:15.716491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:15.782428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 603/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:16.052729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8c794-53f1-4123-8373-cc0a43050baa None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:16.142465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:16.152283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8c794-53f1-4123-8373-cc0a43050baa None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:16.184629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:16.185244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:16.185521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:16.185794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] PATH_INFO: `/v3/domains/8aae4b664e8f49498dbfce0a82c14f6a` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:16.186895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] RBAC: Authorizing `identity:get_domain(domain_id=8aae4b664e8f49498dbfce0a82c14f6a)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:16.188309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e57e29-0ae7-4903-b623-21f6ff2f926d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:16.189880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 573/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 5 10:36:16 2022] GET /identity/v3/domains/8aae4b664e8f49498dbfce0a82c14f6a => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:16.196057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:16.211324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:16.292486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8bc0-6c60-4e87-a6c1-9b23eee11d7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:16.324721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:16.325304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:16.325579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:16.325847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:16.326747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:16.328170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024806a5-fe0b-4185-8733-a89e8ff5e1b0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:16.428230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 604/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:36:16 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:36:18.357389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79a09-7555-4e7f-a3a0-c59a33e6d716 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:18.357914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79a09-7555-4e7f-a3a0-c59a33e6d716 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:18.357914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79a09-7555-4e7f-a3a0-c59a33e6d716 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:18.359208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 574/1178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:18.364355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:18.364797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:18.364939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:18.383737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:18.384987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:18.447523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:18.452129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 605/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:18.723175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79a09-7555-4e7f-a3a0-c59a33e6d716 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:18.823054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79a09-7555-4e7f-a3a0-c59a33e6d716 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:18.855660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:18.856281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:18.856561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:18.856865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:18.867144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:36:18.871930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:18.873192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:36:18.874257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 575/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:18.879202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:18.977005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd367fd-0fe9-4000-9436-c50b7a4d8689 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:19.011681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:19.012289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:19.012566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:19.012872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:19.013531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:19.013830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:19.015205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:19.023104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 606/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:19.029203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:19.050865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:19.126889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc1d42-c9b2-4c87-b255-368966a7eef3 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:19.160117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:19.160759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:19.161037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:19.161308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] PATH_INFO: `/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:19.174731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] RBAC: Authorizing `identity:get_user(user_id=4c3b860ed6f547e0a5f2c91933ae3b05)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:19.176153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:19.177768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 576/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:36:19 2022] GET /identity/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:19.184314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:19.243429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:19.280325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b3a5-1b9e-483b-ae80-4979c73b7364 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:19.313360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:19.313953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:19.314230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:19.314498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:19.379340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:19.380818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:19.437996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:19.475356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 607/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:36:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:36:19.482061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:19.561885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:19.583518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5754b3-6b3b-4c0e-bbc5-730fa56a8ada None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:19.619832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:19.620456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:19.620786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:19.621059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] PATH_INFO: `/v3/projects/d7be7202ae0d4dd782494ce9236adf0f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:19.622215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] RBAC: Authorizing `identity:get_project(project_id=d7be7202ae0d4dd782494ce9236adf0f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:19.623638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815c0b-59d6-471b-bcc5-08c82422d31a None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:19.625285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 577/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:36:19 2022] GET /identity/v3/projects/d7be7202ae0d4dd782494ce9236adf0f => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:19.631404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:19.729347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60593e55-f91f-4b79-b432-7fc7489985fd None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:19.765058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:19.765643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:19.765915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:19.766179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:19.766889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d7be7202ae0d4dd782494ce9236adf0f, user.id=4c3b860ed6f547e0a5f2c91933ae3b05) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:19.767188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:19.768623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1de1b9-078e-4dda-9221-d7ff45edf57c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:19.774463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 608/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:36:19 2022] GET /identity/v3/role_assignments?user.id=4c3b860ed6f547e0a5f2c91933ae3b05&scope.project.id=d7be7202ae0d4dd782494ce9236adf0f&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:21.620283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84f12-f581-4662-90dc-68996a4ca03f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:21.620871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84f12-f581-4662-90dc-68996a4ca03f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:21.620871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84f12-f581-4662-90dc-68996a4ca03f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:21.622226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 578/1186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:21.627436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:21.627838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:21.627993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:21.645994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:21.647164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:21.666857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:21.711424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 609/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:21.982658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84f12-f581-4662-90dc-68996a4ca03f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:22.081739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84f12-f581-4662-90dc-68996a4ca03f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:22.115290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:22.115917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:22.116178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:22.116471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:22.126554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:36:22.131280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:22.132375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:36:22.133664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 579/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:22.138422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:22.234112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7fc09-2074-4b8f-b8d8-b6dc08cf1dfd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:22.266494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:22.267082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:22.267357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:22.267624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:22.268269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:22.268566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:22.269952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:22.278228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 610/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:22.283812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:22.293315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:22.379712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329feb51-3f7c-46fb-92ed-1d91739384ff None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:22.412534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:22.413163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:22.413462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:22.413729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] PATH_INFO: `/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:22.414828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] RBAC: Authorizing `identity:get_user(user_id=4c3b860ed6f547e0a5f2c91933ae3b05)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:22.416232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:22.417802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 580/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:36:22 2022] GET /identity/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:22.423558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:22.442397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:22.521604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc1c06-41db-4ffb-82a4-0548bbf2cc76 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:22.555174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:22.555793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:22.556074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:22.556348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] PATH_INFO: `/v3/projects/d7be7202ae0d4dd782494ce9236adf0f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:22.557531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] RBAC: Authorizing `identity:get_project(project_id=d7be7202ae0d4dd782494ce9236adf0f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:22.558969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd34d73-e991-476d-92c2-71b832a4fc0b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:22.560602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 611/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:36:22 2022] GET /identity/v3/projects/d7be7202ae0d4dd782494ce9236adf0f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:22.566545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:22.642035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:22.665679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8c86-6071-4c3b-b13d-fdb69432969d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:22.699328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:22.699981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:22.700258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:22.700526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] PATH_INFO: `/v3/projects/d7be7202ae0d4dd782494ce9236adf0f/users/4c3b860ed6f547e0a5f2c91933ae3b05/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:22.702681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] RBAC: Authorizing `identity:create_grant(project_id=d7be7202ae0d4dd782494ce9236adf0f, user_id=4c3b860ed6f547e0a5f2c91933ae3b05, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:22.704096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f037230-a77f-4e53-abfe-4309accb2e7f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:22.776358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 581/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:36:22 2022] PUT /identity/v3/projects/d7be7202ae0d4dd782494ce9236adf0f/users/4c3b860ed6f547e0a5f2c91933ae3b05/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:36:24.700169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8327872-38fa-449e-9a81-c5d5a4c2a812 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:24.700744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8327872-38fa-449e-9a81-c5d5a4c2a812 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:24.700744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8327872-38fa-449e-9a81-c5d5a4c2a812 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:24.702325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 612/1193] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:24.707543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:24.707970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:24.708071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:24.726516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:24.727849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:24.794074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 582/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:36:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:36:25.059686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8327872-38fa-449e-9a81-c5d5a4c2a812 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.142750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:25.158176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8327872-38fa-449e-9a81-c5d5a4c2a812 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.190909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.191527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.191806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.192075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.203075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:36:25.207805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:36:25.208954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:36:25.209995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 613/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:36:25.215590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.275758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:25.310947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f114-fad1-462d-a069-17e762ad10e7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.345538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.346134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.346411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.346680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.347333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:25.347628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:25.349011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:25.356920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 583/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:25.362670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.459422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b827e-28ee-4e99-af8a-52293ab7b047 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.492042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.492682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.492962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.493233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] PATH_INFO: `/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.494347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] RBAC: Authorizing `identity:get_user(user_id=4c3b860ed6f547e0a5f2c91933ae3b05)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:25.495784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:25.497383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 614/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/users/4c3b860ed6f547e0a5f2c91933ae3b05 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:25.503318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.602629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee269d01-2244-410c-b38e-79ab0bbc974d None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.627026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:25.636034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.636654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.636934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.637201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.702633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:25.704072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:25.798130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 584/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:36:25.804511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.822320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:25.902647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a23c-c22c-4961-9939-1e45284d4159 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.935216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.935831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.936105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.936373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] PATH_INFO: `/v3/projects/d7be7202ae0d4dd782494ce9236adf0f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.937498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] RBAC: Authorizing `identity:get_project(project_id=d7be7202ae0d4dd782494ce9236adf0f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:25.938916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ad91-ef6e-4beb-996b-87e7fed5345e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:25.940536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 615/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/projects/d7be7202ae0d4dd782494ce9236adf0f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:25.946696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.973006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:26.042949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b98a-59de-45e7-8363-efe4c00d2ca2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:26.077093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:26.077704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:26.077981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:26.078253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:26.079027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d7be7202ae0d4dd782494ce9236adf0f, user.id=4c3b860ed6f547e0a5f2c91933ae3b05) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:36:26.079335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:26.080779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78f1a-2f1b-47d9-9b43-2da60cbbb27b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:26.086585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 585/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/role_assignments?user.id=4c3b860ed6f547e0a5f2c91933ae3b05&scope.project.id=d7be7202ae0d4dd782494ce9236adf0f&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:35.931162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=59 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:36.083774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=55 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:44.536862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e815-d32b-4521-a396-6b024629c01f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:44.538116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e815-d32b-4521-a396-6b024629c01f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:44.538116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e815-d32b-4521-a396-6b024629c01f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:44.539536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 616/1201] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:37:44.544700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:44.545147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:44.545246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:44.563284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:37:44.564476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:37:44.630325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 586/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:37:44.899831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e815-d32b-4521-a396-6b024629c01f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:45.002952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e815-d32b-4521-a396-6b024629c01f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:45.036555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:45.037216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:45.037491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:45.037888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:45.047544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:45.049028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:45.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:45.065094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:45.066303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:45.066303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:45.066303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:45.066303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 617/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:45.074168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:45.170143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e99e1-9105-4b3e-a077-a588ebf92dcb None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:45.198247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:45.203932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:45.204523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:45.204843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:45.205111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:45.205739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:45.206033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:45.207380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f01ca-07e5-4849-8b6e-12ddec42b729 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:45.218576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 587/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:45.224553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:45.277297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:45.322970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a160-1c23-45db-b55c-e2cdf8b51d89 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:45.356044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:45.356738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:45.357019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:45.357290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:45.357939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:45.359427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c7beb-e651-49bb-bcd8-984e0f61fc3f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:45.534900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 618/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 5 10:37:45 2022] POST /identity/v3/users => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:37:47.452002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a9a-3322-44ed-be58-a6be8767550e None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:47.452535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a9a-3322-44ed-be58-a6be8767550e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:47.452535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2a9a-3322-44ed-be58-a6be8767550e None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:47.453980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 588/1206] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:37:47.460015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:47.460454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:47.460556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:47.479119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:37:47.480308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:37:47.544750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 619/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:37:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:37:47.814897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b2a9a-3322-44ed-be58-a6be8767550e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:47.915210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b2a9a-3322-44ed-be58-a6be8767550e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:47.948066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:47.948728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:47.949010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:47.949272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:47.962713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:37:47.967439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:47.968649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:47.969741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 589/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:47.974494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.013895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:48.072212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37184-71f7-4df7-b448-6ec8fd930cb7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.106627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.107228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.107506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.107847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.108503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:48.108832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.110202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:48.117847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 620/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:48.123737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.173958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:48.221823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e66a7-9826-413a-8d7d-4050001c0c31 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.254999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.255617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.255935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.256378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.266682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.268155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:48.282419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:48.283654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:48.284799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:48.284799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:48.284799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:48.284799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 590/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:48.290253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.386769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:48.389798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41039-ec56-46de-9d9a-606c03b1a7d6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.422635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.423233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.423531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.423797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.424429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:48.424758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.426227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:48.437498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 621/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:48.443269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.543464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e48ba3-8afa-41db-b592-6168d8cff2ae None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.545075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:48.577250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.577873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.578153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.578425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.586668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.588095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:37:48.599079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:48.604404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:48.605714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 591/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:48.606494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.706513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de232d-51c3-4fc2-bddd-ba77e754cceb None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.738849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.739541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.739816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.740084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.741344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:48.741645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.743070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:48.763546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 622/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:37:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:48.769463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:48.869622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1f27-2429-4aa3-b506-b861f4ea72c2 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:48.902951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:48.903551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:48.903829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:48.904096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:48.933482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:48.971982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:48.973454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.074039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 592/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:37:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:37:49.080156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:49.099342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:49.176704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb427d-a79d-4b01-833c-57a2d703890b None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:49.209830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:49.210441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:49.210716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:49.210984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:49.220457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:49.222235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:49.236818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:49.242034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:49.243195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:49.243195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:49.243195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:49.243195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 623/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:49.244390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:49.305431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:49.347350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a502-b7be-4bc5-bb68-de03f11dda57 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:49.381394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:49.381995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:49.382273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:49.382545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:49.383184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:49.383485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:49.384927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.395848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 593/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:37:49.401699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:49.470646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:49.500974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446270-7e6f-4ebe-a75c-1f7fe0c48b17 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:49.533512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:49.534136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:49.534413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:49.534682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:49.541768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:49.543220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:37:49.554306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:49.555378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:49.556395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 624/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:49.561293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:49.661608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f744497-2e22-4f0b-ab21-aab39afb4f83 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:49.683547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:49.695694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:49.696304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:49.696600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:49.696887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:49.697574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:49.697875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:49.699290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b169-da65-41ed-a39a-7d0e0033085c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.713323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 594/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:49.719354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:49.817756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704753a7-467a-436a-b3e7-381cbce7bfa5 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:49.845551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:49.851562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:49.852161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:49.852423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:49.852718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:49.853476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=3358589f4e9649beb8bffdf51844b59c) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:49.853725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:49.855137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2284b-b1c4-4b0d-9e88-a985d0148f72 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:49.860408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 625/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:37:49 2022] GET /identity/v3/role_assignments?user.id=3358589f4e9649beb8bffdf51844b59c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:51.734895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394bf1c-24e4-4406-abb1-f49de170fa80 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:51.735423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394bf1c-24e4-4406-abb1-f49de170fa80 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:51.735423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394bf1c-24e4-4406-abb1-f49de170fa80 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:51.736838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 595/1220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:37:51.742179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:51.742584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:51.742725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:51.761086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:37:51.762278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:37:51.827877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 626/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:37:52.100856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394bf1c-24e4-4406-abb1-f49de170fa80 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.202025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394bf1c-24e4-4406-abb1-f49de170fa80 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:52.236968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:52.237589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:52.237862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:52.238131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:52.248063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:37:52.252885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:52.254047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:52.254990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 596/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:52.260847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.358953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda3746-cee8-4fb7-bdeb-8b7c7ca300dc None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:52.382468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:52.392787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:52.393385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:52.393661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:52.393931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:52.398420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:52.398420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:52.398420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:52.404381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 627/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:52.410144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.454994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:52.512357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66a2d-b6d5-4d4d-904d-9f76bf08960e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:52.545121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:52.545738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:52.546015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:52.546283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:52.556451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:52.557906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:52.572700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:52.577689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:52.578614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:52.578614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:52.578614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:52.578614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 597/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:52.580021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.684021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3905a-402f-48a3-a54a-4112d35064f1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:52.717112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:52.717703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:52.717978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:52.718241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:52.718866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:52.719160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:52.720515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:52.731904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 628/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:52.737783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.831263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:52.837781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d705181-6bfa-4620-bd0a-afe9b1cc0a4b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:52.870507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:52.871122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:52.871393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:52.871660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:52.878694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:52.880151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:37:52.890969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:52.892541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:52.893793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 598/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:52.898361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:52.946242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:52.999213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c876-c5f7-4f83-8639-4c682e7b4dc7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.031769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.032362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.032661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.032930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.033640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:53.033936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.035490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.054491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 629/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:37:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:53.060226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:53.157736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a841e8-95e9-4d16-8032-cba6d3602bc5 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.191647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.192271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.192550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.192851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.203514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.204910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:53.219038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:53.225916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:53.227096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:53.227096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:53.227096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:53.227096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 599/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:53.227409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:53.325303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89556899-3533-4ac5-9d7b-2ad2d68ba0c7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.327809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:53.359170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.359774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.360045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.360310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.361017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:53.361314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.362694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.374038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 630/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:53.380072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:53.389582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:53.479291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc697dd-b78f-49fd-a929-a25c2c92cda1 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.511039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.511650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.515819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.515819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.518434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.519851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:37:53.531544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:53.532624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:53.533830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 600/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:53.539459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:53.639084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03feeac-9dc9-4ed3-a06f-5c31f21f3f8e None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.671894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.672494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.672799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.673069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.673843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:53.674140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.675569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b6aa5-baa9-4204-83f3-76681c89d2ce None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.687228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 631/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:53.694071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:53.758594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:53.792275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff2c0-8908-42de-aa02-cdd2a38b7c40 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:53.824669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:53.825322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:53.825595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:53.825858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/3358589f4e9649beb8bffdf51844b59c/roles/aca05a2c2f8f4e9cafbcd81161cab31d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:53.840564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=3358589f4e9649beb8bffdf51844b59c, role_id=aca05a2c2f8f4e9cafbcd81161cab31d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:53.842060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd4a97-e38d-428c-829a-7258916c61c8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:53.937610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 601/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:37:53 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/3358589f4e9649beb8bffdf51844b59c/roles/aca05a2c2f8f4e9cafbcd81161cab31d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:37:55.833829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6184d3-1ab5-48de-989b-0eb7f483c9ea None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:55.834445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6184d3-1ab5-48de-989b-0eb7f483c9ea None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:55.834445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6184d3-1ab5-48de-989b-0eb7f483c9ea None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:55.835848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 632/1233] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:37:55.841003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:55.841373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:55.841545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:55.860170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:37:55.861381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:37:55.926860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 602/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:37:56.202460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6184d3-1ab5-48de-989b-0eb7f483c9ea None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:56.227971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:56.301185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6184d3-1ab5-48de-989b-0eb7f483c9ea None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:56.333674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:56.334824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:56.335102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:56.335370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:56.344887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:37:56.350354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:56.366328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:56.367390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 633/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:56.368274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:56.403502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:56.454359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101b994-26c5-44df-b8e4-bbb68b6c0f4c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:56.488290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:56.488955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:56.489226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:56.489493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:56.490183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] RBAC: Adding query filter params (name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:56.490634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:56.491987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:56.499528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 603/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:56.505259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:56.593463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:56.608659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfb58-6c48-47d5-8bae-c969a7ea3885 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:56.641943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:56.642566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:56.642843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:56.643111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:56.653241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:56.654679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:56.668649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:56.669771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:56.670735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:56.670735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:56.670735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:56.670735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 634/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:56.675665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:56.774769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e286470-3b6e-4c5c-86a2-06e299968456 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:56.783394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:56.807103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:56.807701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:56.807977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:56.808247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:56.808919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:56.809217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:56.810560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:56.822342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 604/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:56.828288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:56.926253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6767ef-14ae-482c-9056-e6661215ff74 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:56.960462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:56.961118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:56.961394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:56.961662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:56.964282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:56.969419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:56.970871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:37:56.981768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:56.983990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:37:56.985030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 635/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:56.988666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:57.088326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78d61-635a-4aeb-b29e-68c41d2c7754 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:57.121849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:57.122447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:57.122720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:57.122986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:57.123714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:57.124007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:57.125535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:57.143053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 605/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:37:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:57.149068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:57.247278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2dc72-09e0-469c-8b95-7811ae6382c6 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:57.280601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:57.281214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:57.281493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:57.281783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:57.341625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:57.347898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:57.349368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:57.444758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 636/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:37:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:37:57.450326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:57.478388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:57.546982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205656d1-02cf-4ef8-ab9f-5c937c4615f9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:57.581201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:57.581821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:57.582093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:57.582360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:57.594295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:57.594295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:37:57.608851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:57.610003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:37:57.610969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:37:57.610969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:37:57.610969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:57.610969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 606/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:57.615740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:57.709542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:57.715089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c3fe-a1ab-4722-80cb-2f56545ce616 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:57.747598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:57.748185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:57.748458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:57.748759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:57.749384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:57.749677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:57.751033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:57.762781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 637/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:57.768580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:57.845395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:57.865381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dbdd-57bc-48db-95df-5195e7b5aa4e None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:57.898096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:57.898712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:57.898985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:57.899250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:57.905646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:57.907060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:37:57.918637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:37:57.919751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:37:57.920816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 607/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:37:57.925786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:58.026272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722bc0e-bbe4-4d56-8bb7-3d276a10fd5a None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:58.059493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:58.060092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:58.060369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:58.060735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:58.061421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:58.061720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:58.063151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580277a1-b44a-4001-8cd5-58378a018310 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:58.075544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 638/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:37:58.082227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:37:58.182001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cba73-7ffc-457b-81a7-c4140da44bfd None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:37:58.214646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:37:58.215239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:37:58.215515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:37:58.215783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:37:58.216622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] RBAC: Adding query filter params (role.id=aca05a2c2f8f4e9cafbcd81161cab31d, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=3358589f4e9649beb8bffdf51844b59c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:37:58.216930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:37:58.218335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bf7c4-f8c0-47aa-ba28-41a4fce0eb07 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:37:58.223994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 608/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:37:58 2022] GET /identity/v3/role_assignments?user.id=3358589f4e9649beb8bffdf51844b59c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=aca05a2c2f8f4e9cafbcd81161cab31d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:00.177187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6a48-5cd0-4294-a4bf-bf0793bdea1a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:00.177725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6a48-5cd0-4294-a4bf-bf0793bdea1a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:00.177725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6a48-5cd0-4294-a4bf-bf0793bdea1a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:00.179138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 639/1247] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:00.184148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:00.184526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:00.184716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:00.190940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:00.211323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:00.211323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:00.269784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 609/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:38:00.538092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad6a48-5cd0-4294-a4bf-bf0793bdea1a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:00.557012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:00.638566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad6a48-5cd0-4294-a4bf-bf0793bdea1a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:00.671131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:00.671746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:00.672027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:00.672290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:00.682575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:38:00.687357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:00.688478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:00.689785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 640/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:00.694525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:00.792042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afdc4-151b-43df-9d59-6180952cc829 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:00.820354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:00.825239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:00.825840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:00.826112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:00.826637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:00.827289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:00.827583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:00.828958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:00.837286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 610/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:00.843239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:00.921045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:00.943509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5492f54-07e7-4b6b-a2f7-53499be16483 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:00.977968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:00.978688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:00.978965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:00.983471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:00.989176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:00.990680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:01.004768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:01.005774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:01.007210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:01.007210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:01.007210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:01.007210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 641/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:01.011809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:01.112370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5864c8e-9183-474f-8a20-b3b5194164f9 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:01.146157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:01.147355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:01.147633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:01.147951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:01.148623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:01.148925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:01.150270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.161695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 611/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:01.167771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:01.266907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff93c6-2ff4-4a68-a430-4fe79b2c40d3 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:01.292876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:01.300521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:01.301167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:01.301444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:01.301710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] PATH_INFO: `/v3/users/placement` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:01.308823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:01.310311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:38:01.321664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:01.322665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:01.323649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 642/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:01.329132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:01.385371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:01.428713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c8c4-6d88-4ca5-9cec-e11b83584830 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:01.463901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:01.464633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:01.464910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:01.465178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:01.465899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:01.466192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:01.467594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.484570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 612/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:38:01.490356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:01.593419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e2a9-8246-4671-a262-4c2afad3d5be None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:01.626860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:01.627464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:01.627740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:01.628008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:01.683814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:01.696187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:01.697703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.792776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 643/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:38:01.798633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:01.898614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320ed3-f59d-4cfd-ab69-b32f91dc76b8 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:01.911237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:01.932218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:01.932878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:01.933156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:01.933453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:01.943206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:01.944570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:01.959504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:01.964161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:01.965429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:01.965429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:01.965429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:01.965429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 613/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:01.966419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:02.054233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:02.066206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10345b86-c2c2-43fd-8a1b-0d0091e0cac2 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:02.099588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:02.100969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:02.105264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:02.105264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:02.105264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:02.105264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:02.105264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:02.114659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 644/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:02.120997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:02.223891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439964a2-7ee2-4fda-b04b-bab1f85b4a1f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:02.259176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:02.259836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:02.260118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:02.260395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:02.267023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:02.268456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:38:02.279777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:02.280924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:02.282117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 614/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:02.286822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:02.386044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001547dd-67f9-4b09-983b-f093c8dadac8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:02.418148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae644fa-1877-495c-a139-89992847e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:02.418744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae644fa-1877-495c-a139-89992847e956 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:02.419020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae644fa-1877-495c-a139-89992847e956 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:02.419289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae644fa-1877-495c-a139-89992847e956 None admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:02.419972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae644fa-1877-495c-a139-89992847e956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:02.420273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae644fa-1877-495c-a139-89992847e956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:02.421739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae644fa-1877-495c-a139-89992847e956 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:02.434125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 645/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:02.440512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:02.466968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:02.540857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b3d5-808e-4602-97f2-13c1e42cdfa7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:02.575766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:02.576664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:02.576945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:02.577221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:02.577945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=3358589f4e9649beb8bffdf51844b59c) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:02.578254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:02.579665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13e537-7a49-4b18-8410-df71f37521cc None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:02.585898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 615/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:38:02 2022] GET /identity/v3/role_assignments?user.id=3358589f4e9649beb8bffdf51844b59c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:04.469617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200844-69bc-4970-8a40-6b5bc72ba06b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:04.470279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200844-69bc-4970-8a40-6b5bc72ba06b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:04.470279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200844-69bc-4970-8a40-6b5bc72ba06b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:04.471545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 646/1261] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:04.477848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:04.478288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:04.478399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:04.496895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:04.498058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:04.564558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 616/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:04.835971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200844-69bc-4970-8a40-6b5bc72ba06b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:04.846846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:04.937968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200844-69bc-4970-8a40-6b5bc72ba06b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:04.976840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:04.977496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:04.977776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:04.978046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:04.988150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:38:04.993688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:04.994789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:04.995732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 647/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:05.000864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.019098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:05.102908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c543af1-4457-42ac-a418-747c12d89aa0 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.137168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.140795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.150310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 617/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:05.155958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.225560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:05.257995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399a181-e3e5-49c9-a6ca-956a6c46d8bf None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.291673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.292298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.292580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.293156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.302626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.304200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:05.319822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:05.321005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:05.322131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:05.322131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:05.322131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:05.322131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 648/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:05.327309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.409638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:05.428458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a484f-0758-4ede-a3a4-cb7504083baf None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.462410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.463007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.463283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.463551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.464219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:05.464625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.466002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.477444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 618/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:05.483192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.581294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35781df7-626c-48c8-86e3-87477f4771f8 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.600230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:05.613990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.614606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.614905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.615177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.622797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.624239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:38:05.635802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:05.637029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:05.643874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 649/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:05.644671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.740028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bf82-ba2a-41c6-adeb-98db36cc322c None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.774792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.775399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.775705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.776212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.777083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:05.777476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.778949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.787667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:05.796330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 619/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:05.802176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:05.903953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0253c-4b14-420f-b956-1d0316509e20 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:05.937112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:05.937734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:05.938063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:05.938275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:05.949278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:05.950730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:05.965715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:05.966864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:05.967866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:05.967866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:05.967866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:05.967866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 650/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:05.972852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:06.073263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba2ff-de2d-4a0f-b31b-37bb8012c816 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:06.106767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:06.107902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:06.107902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:06.107902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:06.108552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:06.108875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:06.110230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:06.121742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 620/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:06.127375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:06.158438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:06.224760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c71d-ef72-43d1-954b-29933b3a0df1 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:06.258381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:06.258996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:06.259298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:06.262754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:06.265901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:06.267333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:38:06.278304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:06.279362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:06.280507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 651/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:06.287269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:06.347027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:06.388810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446ff5-cc74-4dd2-9229-b28ce9909086 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:06.422093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687beff3-953f-417d-a970-25b323dd210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:06.422710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687beff3-953f-417d-a970-25b323dd210c None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:06.422981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687beff3-953f-417d-a970-25b323dd210c None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:06.423248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687beff3-953f-417d-a970-25b323dd210c None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:06.423928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687beff3-953f-417d-a970-25b323dd210c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:06.424227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687beff3-953f-417d-a970-25b323dd210c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:06.425684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687beff3-953f-417d-a970-25b323dd210c None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:06.437712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 621/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:06.443908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:06.535437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:06.544872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8718-9568-4150-a081-baa27cd35336 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:06.578717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:06.579361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:06.579643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:06.579928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] PATH_INFO: `/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/3358589f4e9649beb8bffdf51844b59c/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:06.581843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc34e3070b4d1790aca33e287c8742, user_id=3358589f4e9649beb8bffdf51844b59c, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:06.583301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829f8e-6c79-414e-a3b9-e277781debd0 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:06.686135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 652/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 5 10:38:06 2022] PUT /identity/v3/projects/d0fc34e3070b4d1790aca33e287c8742/users/3358589f4e9649beb8bffdf51844b59c/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:08.574234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1826-dbdf-4d2a-91c8-26a045c9b9e5 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:08.574791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1826-dbdf-4d2a-91c8-26a045c9b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:08.574791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1826-dbdf-4d2a-91c8-26a045c9b9e5 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:08.576118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 622/1274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:08.581520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:08.581913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:08.582062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:08.600072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:08.601340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:08.666917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 653/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:08.947878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1826-dbdf-4d2a-91c8-26a045c9b9e5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.050211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1826-dbdf-4d2a-91c8-26a045c9b9e5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.067258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:09.083509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.084145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.084409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.084740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.094480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:38:09.099281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:09.101730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:09.102817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 623/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 5 10:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:09.107015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.187091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:09.204169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb535a9-9774-4870-97ab-43eb5ad505c6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.237108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.237710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.237983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.238248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.238949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:09.239288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:09.240672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:09.249045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 654/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:09.254707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.353344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc661c7-8c27-4fb8-98b8-009477d5d8c0 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.386000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.386621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.386917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.387169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.397498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:09.398936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:09.413641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:09.429189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:09.430335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:09.430335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:09.430335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:09.430335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 624/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:09.430613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.519244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b37b-1b68-44c4-8b39-4fa1c2e8ef8c None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.553887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.554484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.554758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.555025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.555657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:09.555953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:09.557343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:09.568654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 655/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:09.574515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.606823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:09.674774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21c1a-5d0a-4e6e-9265-c8c948437684 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.707417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.708024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.708299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.708567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.716403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:09.717858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:38:09.728781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:09.730172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:09.731216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 625/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:09.735905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.739776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:09.832287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4ab6-da2a-4211-ae0f-9736d1f75be7 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:09.867039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:09.867647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:09.867921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:09.868187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:09.868929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:09.869224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:09.870641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:09.887498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 656/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:09.893304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:09.985515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:09.995591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4c79-c60a-4feb-9caf-cbfe2b033797 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.027658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.028255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.028545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.028817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.097219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.098589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.184797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:10.195115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 626/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 5 10:38:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:38:10.201479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:10.264144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:10.305641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147aad-9c0a-473a-ace6-ae5349f9e437 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.339439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.340062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.340342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.340633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.353983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.353983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:38:10.367753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:10.368947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:38:10.370089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:38:10.370089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:38:10.370089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:10.370089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 657/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:10.374895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:10.473412 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904e94a-807f-44f8-909a-27182f8dd164 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.508178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.508796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.509076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.509340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.509975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:10.510271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.511615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.523078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 627/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 5 10:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:10.528865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:10.629052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173814f-2431-427a-aadb-6551ad87ca7f None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.644835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:10.665138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.665769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.666046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.666315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.673833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.675447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:38:10.687286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:10.688729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: ERROR keystone.server.flask.application Sep 05 10:38:10.690099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 658/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 5 10:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:10.695539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:10.745301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:10.794498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee54b6-eae2-425e-8dff-539521e2ae4b None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.827665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.828283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.828576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.828849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.829526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:10.829821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.831224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ec8d5-2434-4b1d-977b-1dc718425734 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.844107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 628/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 5 10:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:10.850067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:10.947566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2f0c9-2b62-4787-80bf-16d33d35a444 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:10.980787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:10.981381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:10.981653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:10.981915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:10.982633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] RBAC: Adding query filter params (role.id=48e3bab9028e4370a46d727b6f58ef26, scope.project.id=d0fc34e3070b4d1790aca33e287c8742, user.id=3358589f4e9649beb8bffdf51844b59c) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:10.982929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:10.984342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a59c0-a982-44c2-8766-4ae287135974 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:10.990232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 659/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 5 10:38:10 2022] GET /identity/v3/role_assignments?user.id=3358589f4e9649beb8bffdf51844b59c&scope.project.id=d0fc34e3070b4d1790aca33e287c8742&role.id=48e3bab9028e4370a46d727b6f58ef26 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:12.900961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb1a-1cf1-4d59-906b-a5c41ef01ac2 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:12.901534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb1a-1cf1-4d59-906b-a5c41ef01ac2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:12.901534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218eb1a-1cf1-4d59-906b-a5c41ef01ac2 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:12.902816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 629/1288] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:12.907893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:12.908278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:12.908451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:12.927058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:12.928841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:12.958783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:12.995986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 660/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:13.264900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218eb1a-1cf1-4d59-906b-a5c41ef01ac2 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:13.368442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218eb1a-1cf1-4d59-906b-a5c41ef01ac2 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:13.379134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:13.402413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:13.403039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:13.403318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:13.403590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:13.404168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:13.405556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:13.414240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:13.416457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:13.417559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 630/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:38:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:13.421395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:13.519347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e653-1bb0-453e-8a8b-8fabd4ea5e40 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:13.556140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:13.556831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:13.557121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:13.557397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:13.558028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] RBAC: Adding query filter params (name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:13.558331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:13.559811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb742b-c370-4ee5-aafc-7ac86a0eb5af None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:13.564582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 661/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 5 10:38:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:13.570653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:13.670519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909a07-4fd7-4ffa-b95e-a5a4cbe590c7 None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:13.703595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:13.704190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:13.704463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:13.704762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] PATH_INFO: `/v3/services` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:13.705384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:13.705679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:13.707019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3aa4-4434-413c-a79a-8dacf2b09701 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:13.712205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 631/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 5 10:38:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:15.598721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50ebf-b063-4199-945b-b9a641fb06fd None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.599328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50ebf-b063-4199-945b-b9a641fb06fd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.599440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50ebf-b063-4199-945b-b9a641fb06fd None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.600796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 662/1293] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:15.605964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad433ca3-d1a3-416c-ad11-f2fdfcfae0b6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.606373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad433ca3-d1a3-416c-ad11-f2fdfcfae0b6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.606509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad433ca3-d1a3-416c-ad11-f2fdfcfae0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.625133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ad433ca3-d1a3-416c-ad11-f2fdfcfae0b6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:15.626351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ad433ca3-d1a3-416c-ad11-f2fdfcfae0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:15.656232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:15.692397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 632/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:15.967201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50ebf-b063-4199-945b-b9a641fb06fd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:15.999075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:16.067403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50ebf-b063-4199-945b-b9a641fb06fd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.103609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.104309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.104610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.104889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.105547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.106912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426d5c-9844-4d06-b136-d5a7b2de8c0b None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.217485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 663/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:18.200277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0218-d8ef-498f-8f2f-11c93ae71267 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.200906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0218-d8ef-498f-8f2f-11c93ae71267 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.200906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0218-d8ef-498f-8f2f-11c93ae71267 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.202507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 633/1296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:18.208066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.208465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.208646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.228246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:18.229508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:18.304823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 664/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:18.584699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b0218-d8ef-498f-8f2f-11c93ae71267 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.689832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b0218-d8ef-498f-8f2f-11c93ae71267 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.726060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.726689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.726966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.727235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.727816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.729201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:18.737865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:18.739125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:18.740217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 634/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:18.745539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.764366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.843604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e830-20e1-4611-b157-1a7b307a8309 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.877632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.878230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.878506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.878773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.879392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:18.879688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.881739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.886760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 665/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:18.892892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.924134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.999051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdac7c-ef04-4893-bc81-0d5f027d4a3f None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.036093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.036787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.042410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.042410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.042410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] RBAC: Adding query filter params (interface=public, service_id=d63f54518b1e4f1db94e3e2695a48f0b, region_id=RegionOne) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:19.042410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.042410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40e57-f291-4d3a-a783-7851f466f2d1 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.045739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 635/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/endpoints?service_id=d63f54518b1e4f1db94e3e2695a48f0b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:19.051747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.142015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:19.160218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a83461-ef4e-479c-8860-46ec46779f41 None admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.198007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.198759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.199038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.199309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.199924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.201600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657148e-0d11-416c-80f0-41287404a6e4 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.209393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 666/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:21.143068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf29-0d64-4705-8749-a619e95ef50d None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.143632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf29-0d64-4705-8749-a619e95ef50d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.143632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf29-0d64-4705-8749-a619e95ef50d None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.144988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 636/1302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:21.150498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.154602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.154602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.170233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:21.171402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:21.237635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 667/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:38:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:38:21.506318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282cf29-0d64-4705-8749-a619e95ef50d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.602835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:21.609385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282cf29-0d64-4705-8749-a619e95ef50d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.643305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.643932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.644284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.644561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.645179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.647062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:38:21.656432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:38:21.657634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application with Lock( Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: ERROR keystone.server.flask.application Sep 05 10:38:21.658494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 637/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 5 10:38:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:38:21.664172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.739165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:21.763295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85794a-78db-41f4-a343-318e5366ab0a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.796161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.796790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.797068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.797334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] PATH_INFO: `/v3/services` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.797950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:21.798244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.799608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890184cb-4df8-437d-b06c-6c08e437ceb2 None admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.804650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 668/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 5 10:38:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:38:21.810316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.909803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468c580-f300-480c-ba65-16421fa8b7bf None admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.942721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.943809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.944096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.944351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.945030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.946375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5d6ac-6f64-412b-a968-854d626807d7 None admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:22.051534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 638/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:31.801679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=30 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:32.046704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:11.377820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17639c6-271b-404e-a3ba-ad2ed0b1096c None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:11.379704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17639c6-271b-404e-a3ba-ad2ed0b1096c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:11.380142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17639c6-271b-404e-a3ba-ad2ed0b1096c None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:11.386999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6b42a-b00e-42e7-b56c-0315cba2b696 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:11.393031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6b42a-b00e-42e7-b56c-0315cba2b696 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:11.393031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6b42a-b00e-42e7-b56c-0315cba2b696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:11.393238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 669/1307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:11.499500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f7b6b42a-b00e-42e7-b56c-0315cba2b696 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:11.501205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f7b6b42a-b00e-42e7-b56c-0315cba2b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:11.657500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 639/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:45:11.968761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:11.969280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:11.969699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:11.971530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 670/1309] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 5 10:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:11.979239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc666-585f-43c1-b73e-6de763d48e59 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:11.979524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc666-585f-43c1-b73e-6de763d48e59 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:11.979847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc666-585f-43c1-b73e-6de763d48e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:12.087005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c6cfc666-585f-43c1-b73e-6de763d48e59 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:12.088670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c6cfc666-585f-43c1-b73e-6de763d48e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:12.112897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:12.189821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 640/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 5 10:45:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:45:12.190591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:12.193080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:12.337363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e0ea-0446-427a-a8ca-7264323230ee None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:12.429402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:12.430812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:12.431267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:12.431686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:12.433626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:12.498953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:12.562124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:12.563564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542e58e-10ef-4bf4-9d18-932a98d8be79 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:12.585011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 671/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:14.844042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:14.844703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:14.844703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:14.846092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 641/1312] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:14.851203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e53d55-ed8d-49a9-ae4e-48a55c7d1f7a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:14.851621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e53d55-ed8d-49a9-ae4e-48a55c7d1f7a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:14.851824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e53d55-ed8d-49a9-ae4e-48a55c7d1f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:14.923991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d8e53d55-ed8d-49a9-ae4e-48a55c7d1f7a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:14.925615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d8e53d55-ed8d-49a9-ae4e-48a55c7d1f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:15.032820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 672/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:15.314451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:15.316870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:15.424193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9d3b-8c24-4231-9bf0-45c2c54b8fd6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:15.493561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:15.496233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:15.496880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:15.497164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:15.497434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:15.499046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:15.606280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:15.607707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8e32c-0b82-4333-90b8-b640ac167e6b service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:15.626707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 642/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:18.091756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfb7c-33da-47d3-a035-ff560673133a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:18.092307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfb7c-33da-47d3-a035-ff560673133a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:18.092307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfb7c-33da-47d3-a035-ff560673133a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:18.093748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 673/1315] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:18.099694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c4c0-b20f-44b3-b2e9-fa0a5acdef57 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:18.100108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c4c0-b20f-44b3-b2e9-fa0a5acdef57 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:18.103000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c4c0-b20f-44b3-b2e9-fa0a5acdef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:18.165070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-63f1c4c0-b20f-44b3-b2e9-fa0a5acdef57 None None] MFA Rules not processed for user `4dd7566ac1204db28ef70c6510a539b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:18.166287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-63f1c4c0-b20f-44b3-b2e9-fa0a5acdef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:18.218496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:18.262387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 643/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:18.559089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:18.559366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:18.559636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:18.561031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 674/1317] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 5 10:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:18.567434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c38ed-f117-4eda-ab3b-8564e302bdd7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:18.567714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c38ed-f117-4eda-ab3b-8564e302bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:18.567991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c38ed-f117-4eda-ab3b-8564e302bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:18.641872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c36c38ed-f117-4eda-ab3b-8564e302bdd7 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:18.643129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c36c38ed-f117-4eda-ab3b-8564e302bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:18.719136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 644/1318] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 5 10:45:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:18.728343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:18.729977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:18.739654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:18.834498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c1247-1991-42ac-8f6e-1c6aaff51b9f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:18.905264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:18.905865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:18.906143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:18.906413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:18.908000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:18.969999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:19.015982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:19.017473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205b2fa-9853-4356-b278-7d8d74b19b29 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:19.035782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 675/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:22.083386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:22.083959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:22.083959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:22.085376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 645/1320] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:22.090444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509f67-a048-4000-b9e9-fc7b9341ec60 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:22.090898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509f67-a048-4000-b9e9-fc7b9341ec60 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:22.091001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff509f67-a048-4000-b9e9-fc7b9341ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:22.155951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ff509f67-a048-4000-b9e9-fc7b9341ec60 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:22.157175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ff509f67-a048-4000-b9e9-fc7b9341ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:22.252095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 676/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:22.539870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:22.541525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:22.591702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:22.643591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763444dd-7551-429a-8635-716a4c07cbdd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:22.715672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:22.716281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:22.716554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:22.716855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:22.718428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:22.813439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:22.827584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:22.829083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dbed2-d61c-4bdc-903a-10a851d6dc91 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:22.848713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 646/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:25.769374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:25.769969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:25.770079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:25.771388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 677/1323] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:25.776559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008f42-6375-4c97-a1ca-149e7633e5c9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:25.777060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008f42-6375-4c97-a1ca-149e7633e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:25.777165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008f42-6375-4c97-a1ca-149e7633e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:25.845102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-03008f42-6375-4c97-a1ca-149e7633e5c9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:25.846314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-03008f42-6375-4c97-a1ca-149e7633e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:25.948507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 647/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:26.241685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:26.244252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:26.263882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:26.353707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ff64-1922-41e9-9f52-84807f462660 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:26.428677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:26.429287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:26.429561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:26.429828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:26.431418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:26.502071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:26.540571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:26.542083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0793c-04a7-443b-8f73-6dd21dd15e1b service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:26.561185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 678/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:28.523481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:28.524008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:28.524008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:28.525384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 648/1326] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:28.530510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87964eb-1030-4bd7-91f9-124beab6f5e4 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:28.530962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87964eb-1030-4bd7-91f9-124beab6f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:28.531126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87964eb-1030-4bd7-91f9-124beab6f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:28.599191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c87964eb-1030-4bd7-91f9-124beab6f5e4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:28.600419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c87964eb-1030-4bd7-91f9-124beab6f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:28.699394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 679/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:28.982539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:28.984152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:29.046344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:29.089875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b60a8-23ff-4893-8d02-51415f5da2ca None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:29.169702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:29.170305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:29.170579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:29.170846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:29.172425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:29.278237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:29.280504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:29.281965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049086d9-6d35-4d9a-984a-805f2fe8267e service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:29.307162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 649/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:31.263553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:31.264059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:31.264059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:31.265361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 680/1329] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:31.271263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f709-b995-48e3-963c-fe146fe73c79 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:31.271717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f709-b995-48e3-963c-fe146fe73c79 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:31.271823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f709-b995-48e3-963c-fe146fe73c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:31.338355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ae55f709-b995-48e3-963c-fe146fe73c79 None None] MFA Rules not processed for user `4dd7566ac1204db28ef70c6510a539b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:31.339550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ae55f709-b995-48e3-963c-fe146fe73c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:31.434641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 650/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:31.718371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:31.719988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:31.752551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:31.826413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bda927-6839-4dee-8a91-4b89284cc47c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:31.911731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:31.912404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:31.912898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:31.915075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:31.917370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:32.007003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:32.038283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:32.039775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb29bf-ba71-46b8-9243-8933e719f1df service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:32.058385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 681/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:34.394419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:34.394940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:34.394940 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:34.396290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 651/1332] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:34.401389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4760f-b795-4a31-9dc9-17f9b087afa2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:34.401809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4760f-b795-4a31-9dc9-17f9b087afa2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:34.401942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4760f-b795-4a31-9dc9-17f9b087afa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:34.468998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-13f4760f-b795-4a31-9dc9-17f9b087afa2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:34.470208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-13f4760f-b795-4a31-9dc9-17f9b087afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:34.565924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 682/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:34.849989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:34.851580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:34.921048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:34.957951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e541f-8053-4929-bbd2-4904a34dada2 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:35.030955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:35.031551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:35.031824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:35.032089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:35.033688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:35.142949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:35.144470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9d19-1bb5-4267-aff4-3a13c7dcc271 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:35.154350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:35.163051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 652/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:37.118105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:37.118653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:37.118653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:37.120032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 683/1335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:37.125092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad083-cda7-4d42-add1-e37841c67f9f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:37.125626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad083-cda7-4d42-add1-e37841c67f9f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:37.125724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bad083-cda7-4d42-add1-e37841c67f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:37.191322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d9bad083-cda7-4d42-add1-e37841c67f9f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:37.192534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d9bad083-cda7-4d42-add1-e37841c67f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:37.286341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 653/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:37.569634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:37.571221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:37.611121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:37.673738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2e01-bf43-48ba-aac9-940eb63e2da8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:37.745137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:37.745736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:37.746008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:37.746277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:37.747866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:37.829382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:37.856043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:37.857554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0c31d-45a5-4ec3-813a-43f4496f2256 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:37.877261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 684/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:40.509127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:40.509697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:40.509697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:40.510998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 654/1338] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:40.516113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a37d4-7ec0-45b3-8f45-2757e4b37111 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:40.516511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a37d4-7ec0-45b3-8f45-2757e4b37111 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:40.516679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a37d4-7ec0-45b3-8f45-2757e4b37111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:40.580559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-442a37d4-7ec0-45b3-8f45-2757e4b37111 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:40.582710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-442a37d4-7ec0-45b3-8f45-2757e4b37111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:40.678141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 685/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:40.967008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:40.968533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:41.043101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:41.070679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff20a-f638-4d44-8e20-cee0e92b9dfd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:41.143310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:41.143956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:41.144233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:41.144500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:41.146167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:41.269287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:41.269287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c306-f586-4e4d-8dcd-c07e47cf26c7 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:41.278430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 655/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:45.367434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:45.367992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:45.368090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:45.369615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 686/1341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:45.374701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13dc0-fb4c-4553-a4a9-7c8eaad75408 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:45.375090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13dc0-fb4c-4553-a4a9-7c8eaad75408 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:45.375250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13dc0-fb4c-4553-a4a9-7c8eaad75408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:45.381007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:45.446715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3de13dc0-fb4c-4553-a4a9-7c8eaad75408 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:45.447885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3de13dc0-fb4c-4553-a4a9-7c8eaad75408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:45.548470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 656/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:45.831490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:45.833342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:45.881681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:45.937357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4f69-ab93-418f-9f10-bc24a6d87755 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:46.015117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:46.015728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:46.016005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:46.016274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:46.017892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:46.114478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:46.131040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:46.132520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b127-cd41-467d-8c1f-e0b144877ec9 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:46.151189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 687/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:48.998465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:48.999023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:48.999023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:49.000420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 657/1344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:49.006267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b3b2-1895-40d9-a447-78712db81116 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:49.006699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b3b2-1895-40d9-a447-78712db81116 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:49.006819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b3b2-1895-40d9-a447-78712db81116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:49.074452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8125b3b2-1895-40d9-a447-78712db81116 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:49.075656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8125b3b2-1895-40d9-a447-78712db81116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:49.172810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 688/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:49.458962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:49.460565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:49.547789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:49.568104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bcae3-f59f-4dec-8ff4-efcc46527038 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:49.646346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:49.646958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:49.647239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:49.647512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:49.649136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:49.761922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:49.763359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c571-2520-4f02-8d9f-840cd9d896fd service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:49.781780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 658/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:53.948516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:53.949141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:53.949141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:53.950480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 689/1347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:53.957055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c86e-a1f7-437a-918e-7ba9306ad5e9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:53.957508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c86e-a1f7-437a-918e-7ba9306ad5e9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:53.957736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0c86e-a1f7-437a-918e-7ba9306ad5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:53.973939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:54.030384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-66e0c86e-a1f7-437a-918e-7ba9306ad5e9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:54.031604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-66e0c86e-a1f7-437a-918e-7ba9306ad5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.135292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 659/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:54.423003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:54.425100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.483859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:54.530743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed178ef1-df46-485a-9bad-a40138932865 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:54.603591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:54.604192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:54.604465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:54.604766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:54.606341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.710842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:54.714404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:54.715851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09daf14-3ecd-405f-8656-e675313a94e2 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:54.734680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 690/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:59.771789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a34f-60c0-4002-b1a0-909d63ab142c None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:59.772252 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a34f-60c0-4002-b1a0-909d63ab142c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:59.772439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a34f-60c0-4002-b1a0-909d63ab142c None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:59.774876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 660/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:45:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:45:59.780207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe3e-71c5-4a44-82e2-f1123d6e9930 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:59.780652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe3e-71c5-4a44-82e2-f1123d6e9930 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:59.780863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe3e-71c5-4a44-82e2-f1123d6e9930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:59.880381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-dbe1fe3e-71c5-4a44-82e2-f1123d6e9930 None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:59.882070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dbe1fe3e-71c5-4a44-82e2-f1123d6e9930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:00.070201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 691/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:45:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:04.133546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=59 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:04.386583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39775-18b3-43dc-8e19-63931a9fea6a None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:04.387092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39775-18b3-43dc-8e19-63931a9fea6a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:04.387541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39775-18b3-43dc-8e19-63931a9fea6a None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:04.389354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 661/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:04.394155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d2db6-f25e-4f77-82b8-cd1965628eca None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:04.394621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d2db6-f25e-4f77-82b8-cd1965628eca None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:04.394795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d2db6-f25e-4f77-82b8-cd1965628eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:04.454764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:04.479782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-588d2db6-f25e-4f77-82b8-cd1965628eca None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:04.481146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-588d2db6-f25e-4f77-82b8-cd1965628eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:04.594560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 692/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:05.948833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666a82-1b8e-4c86-bd06-bdbe46cf79ce None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:05.949350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666a82-1b8e-4c86-bd06-bdbe46cf79ce None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:05.949461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666a82-1b8e-4c86-bd06-bdbe46cf79ce None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:05.950947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 662/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:05.958141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9613e-7365-4edc-91aa-677e792a8a27 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:05.958586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9613e-7365-4edc-91aa-677e792a8a27 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:05.958672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9613e-7365-4edc-91aa-677e792a8a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:06.035752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-63f9613e-7365-4edc-91aa-677e792a8a27 None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:06.037002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-63f9613e-7365-4edc-91aa-677e792a8a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:06.078762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:06.146037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 693/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:46:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:09.489085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a05a2-340d-4204-9b97-204dc5ff1df8 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:09.489623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a05a2-340d-4204-9b97-204dc5ff1df8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:09.489623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a05a2-340d-4204-9b97-204dc5ff1df8 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:09.491160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 663/1356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:09.497057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b9c9-c7f5-498b-b3fb-8a269d341f96 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:09.497476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b9c9-c7f5-498b-b3fb-8a269d341f96 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:09.497605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b9c9-c7f5-498b-b3fb-8a269d341f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:09.564864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-96c3b9c9-c7f5-498b-b3fb-8a269d341f96 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:09.566334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-96c3b9c9-c7f5-498b-b3fb-8a269d341f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:09.693796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 694/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:10.008809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:10.009939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:10.010228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:10.011614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 664/1358] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 5 10:46:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:10.021633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986589-27d0-4ec5-a612-042050869c09 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:10.022563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986589-27d0-4ec5-a612-042050869c09 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:10.023016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986589-27d0-4ec5-a612-042050869c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:10.043702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:10.108535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d8986589-27d0-4ec5-a612-042050869c09 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:10.109979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d8986589-27d0-4ec5-a612-042050869c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:10.232540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 695/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 5 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:10.242753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:10.244392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:10.411028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bab12d-3123-4261-9e51-05990d850fd8 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:10.491657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:10.534156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:10.534981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:10.535362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:10.535739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:10.537652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:10.635920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:10.637571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26d3e3-7e39-461e-8c64-581a24be9340 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:10.656852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 665/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:46:12.843548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:12.844061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:12.844172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:12.846225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 696/1361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:12.851632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1a36-de04-4b6d-85ca-313e0bdb9be6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:12.851632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1a36-de04-4b6d-85ca-313e0bdb9be6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:12.852219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1a36-de04-4b6d-85ca-313e0bdb9be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:12.922760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-fbfb1a36-de04-4b6d-85ca-313e0bdb9be6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:12.924997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fbfb1a36-de04-4b6d-85ca-313e0bdb9be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:12.968747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:13.040721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 666/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:13.352877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:13.352877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:13.440404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:13.538935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc539f-8aff-494c-8a7f-4101a09c63ee None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:13.683343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:13.684387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:13.684806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:13.685088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:13.686986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:13.721337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:13.798092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:13.800209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e36d3f-a035-4f37-a013-f021cee08d7a service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:13.819731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 697/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:16.243912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5512-a3e1-4873-9eb1-ab8aa23a4a27 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:16.244428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5512-a3e1-4873-9eb1-ab8aa23a4a27 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:16.244428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5512-a3e1-4873-9eb1-ab8aa23a4a27 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:16.245975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 667/1364] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:16.250909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c687c2-f5b0-465e-8532-5cb73593f40f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:16.251365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c687c2-f5b0-465e-8532-5cb73593f40f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:16.252118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c687c2-f5b0-465e-8532-5cb73593f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:16.326775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-93c687c2-f5b0-465e-8532-5cb73593f40f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:16.328058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-93c687c2-f5b0-465e-8532-5cb73593f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:16.440625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:16.444652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 698/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:16.752976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:16.753324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:16.753870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:16.755351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 668/1366] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 5 10:46:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:16.761369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a298e-ce87-48ca-a9b9-c8c8c56be2de None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:16.770975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a298e-ce87-48ca-a9b9-c8c8c56be2de None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:16.770975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a298e-ce87-48ca-a9b9-c8c8c56be2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:16.850694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-217a298e-ce87-48ca-a9b9-c8c8c56be2de None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:16.852043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-217a298e-ce87-48ca-a9b9-c8c8c56be2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:16.992288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 699/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 5 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:16.999799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:17.001480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:17.168137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d036800-c30b-4b3b-be1e-fc0af411bffc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:17.190825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:17.298030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:17.299456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:17.299623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:17.299878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:17.301388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:17.400476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:17.402534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc157-405e-4f7d-9723-b2ecc3ddb9b5 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:17.422893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 669/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:17.781996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdd518-5186-4dde-9efc-e25cb7a6c5b1 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:17.782527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdd518-5186-4dde-9efc-e25cb7a6c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:17.783251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdd518-5186-4dde-9efc-e25cb7a6c5b1 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:17.785862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 700/1369] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:17.790430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8dd5-63d9-49fe-b1c0-c0ca1abd75b8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:17.790710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8dd5-63d9-49fe-b1c0-c0ca1abd75b8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:17.790983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8dd5-63d9-49fe-b1c0-c0ca1abd75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:17.825251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:17.862322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-235f8dd5-63d9-49fe-b1c0-c0ca1abd75b8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:17.864281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-235f8dd5-63d9-49fe-b1c0-c0ca1abd75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:17.977668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 670/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:18.555017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:18.555017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:18.555017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:18.557941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 701/1371] 10.222.0.26 () {54 vars in 964 bytes} [Mon Sep 5 10:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:18.560685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bb5f-b952-4fda-9b7b-2eb96f62889f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:18.561185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bb5f-b952-4fda-9b7b-2eb96f62889f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:18.561346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4bb5f-b952-4fda-9b7b-2eb96f62889f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:18.640392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-22e4bb5f-b952-4fda-9b7b-2eb96f62889f None None] MFA Rules not processed for user `e7dce5cc34ce4930ade1d9ba9e3bddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:18.641645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-22e4bb5f-b952-4fda-9b7b-2eb96f62889f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:18.692890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:18.730201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 671/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Sep 5 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:46:18.739094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:18.740840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:18.796930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:18.854629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef303f-30f6-42a6-90cf-d696cb8290f3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:18.932486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:18.933225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:18.933605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:18.933911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:18.935817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:19.042955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:19.058561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:19.058561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efe4cf-528f-494a-bbb9-dacdc4f13c2d service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:19.088880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 702/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:46:19.578059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0105-30c4-453b-b462-ef976c524025 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:19.578622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0105-30c4-453b-b462-ef976c524025 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:19.578622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0105-30c4-453b-b462-ef976c524025 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:19.580528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 672/1374] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:19.585964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3fe7-beb0-4aac-95a0-e9ac98240a97 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:19.586248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3fe7-beb0-4aac-95a0-e9ac98240a97 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:19.586519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3fe7-beb0-4aac-95a0-e9ac98240a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:19.652090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-278a3fe7-beb0-4aac-95a0-e9ac98240a97 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:19.653324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-278a3fe7-beb0-4aac-95a0-e9ac98240a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:19.757545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 703/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:20.040165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e0105-30c4-453b-b462-ef976c524025 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:20.041816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-724e0105-30c4-453b-b462-ef976c524025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:20.190180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e0105-30c4-453b-b462-ef976c524025 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:20.243378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:20.305809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:20.306419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:20.306698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:20.307057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:20.308750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:20.400022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:20.401709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8f5e8-b4d5-4f73-bd93-aa7fb7164fca service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:20.420195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 673/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:22.484522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:22.485177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:22.485177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:22.487341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 704/1377] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:22.492499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791212-f6d3-4ec5-90b7-9758f5d6450e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:22.492946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791212-f6d3-4ec5-90b7-9758f5d6450e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:22.493203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791212-f6d3-4ec5-90b7-9758f5d6450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:22.558286 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6a791212-f6d3-4ec5-90b7-9758f5d6450e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:22.559533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6a791212-f6d3-4ec5-90b7-9758f5d6450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:22.566621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:22.663105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 674/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:22.993394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:22.994914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:23.064569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:23.160348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f892a8-753d-47c2-b5cf-56705353704d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:23.289129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:23.289799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:23.290083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:23.290355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:23.291983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:23.313142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:23.394245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:23.395785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439d0a6-7573-4082-924c-dfb37d721dfe service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:23.418385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 705/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:25.553998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:25.554554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:25.554554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:25.556972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 675/1380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:25.562446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da48f7-c371-4f08-bdc8-d6420e58624b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:25.562912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da48f7-c371-4f08-bdc8-d6420e58624b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:25.563006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da48f7-c371-4f08-bdc8-d6420e58624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:25.636569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-97da48f7-c371-4f08-bdc8-d6420e58624b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:25.637912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-97da48f7-c371-4f08-bdc8-d6420e58624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:25.755598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:25.768934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 706/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:26.061731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:26.068062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:26.210323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:26.221507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5a63-bb49-4fb9-b6a4-a95bb76f5354 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:26.341411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:26.341957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:26.342235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:26.342504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:26.344075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:26.441803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:26.443409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa48df-43ef-4f53-a87d-e75c77acc78a service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:26.454824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:26.468927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 676/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:29.044100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:29.044671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:29.044827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:29.046210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 707/1383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:29.052048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4986e1-1097-4d57-9104-3f04eb7899e4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:29.052509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4986e1-1097-4d57-9104-3f04eb7899e4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:29.052629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4986e1-1097-4d57-9104-3f04eb7899e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:29.123578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-0f4986e1-1097-4d57-9104-3f04eb7899e4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:29.124888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0f4986e1-1097-4d57-9104-3f04eb7899e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:29.226840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 677/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:46:29.528534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:29.530586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:29.695287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee3838-5c0f-4942-af2b-eef00d25e717 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:29.771722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:29.823529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:29.824188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:29.824492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:29.824814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:29.826543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:29.925222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:29.926885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b430-e85e-457a-8366-841c632694fe service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:29.946660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 708/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:46:31.930407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:31.930947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:31.931039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:31.932316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 678/1386] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:31.937774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf76d-5182-42a4-86b6-a193f4d0fdb0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:31.938273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf76d-5182-42a4-86b6-a193f4d0fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:31.938441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccf76d-5182-42a4-86b6-a193f4d0fdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:32.013837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e6ccf76d-5182-42a4-86b6-a193f4d0fdb0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:32.015087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e6ccf76d-5182-42a4-86b6-a193f4d0fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:32.050627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:32.127221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 709/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:32.433054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:32.434980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:32.514639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:32.587143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332cf69-3690-4132-a6c1-4177f984b2c6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:32.707318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:32.707851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:32.708134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:32.709045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:32.710665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:32.751607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:32.805076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:32.806667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387be08-276a-41ea-be1b-d0f08ad11fb9 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:32.825077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 679/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:34.494193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a7f2-7aba-4e16-a475-121d3e9c486a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.494781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a7f2-7aba-4e16-a475-121d3e9c486a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.494781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a7f2-7aba-4e16-a475-121d3e9c486a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:34.496104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 710/1389] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:34.501224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382d66-57ce-4377-a0d7-d612c5eea621 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.501712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382d66-57ce-4377-a0d7-d612c5eea621 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.501805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382d66-57ce-4377-a0d7-d612c5eea621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:34.569741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-db382d66-57ce-4377-a0d7-d612c5eea621 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:34.571215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-db382d66-57ce-4377-a0d7-d612c5eea621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:34.671049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 680/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:34.930409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744794a-a2f8-45c5-bc9a-64c6f85695c8 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.930816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744794a-a2f8-45c5-bc9a-64c6f85695c8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.931177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744794a-a2f8-45c5-bc9a-64c6f85695c8 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:34.932638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 711/1391] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:34.937723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.938046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.938393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:34.961763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:34.979034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5cfb-3137-4e22-b104-9f3c33390cb5 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.979320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5cfb-3137-4e22-b104-9f3c33390cb5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.979601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc5cfb-3137-4e22-b104-9f3c33390cb5 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:34.980997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 712/1392] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 5 10:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:46:34.985801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:34.986109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:34.986387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:35.014859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:35.016093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.064272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] MFA Rules not processed for user `b0c38e0197d54850803f0cf9a3419dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:35.076196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.115736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 681/1393] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:35.143567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 713/1394] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 5 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:46:35.151379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:35.152575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.242303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc575-164c-4948-a3bf-ec7cd54cb5c7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:35.249588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:35.326855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:35.327456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:35.327730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:35.327999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:35.329753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.407855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:35.409083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.439656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:35.442579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:35.444110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e5cf7-c8f2-4bc4-85cc-19dca0ea6035 service glance] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:35.463703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 682/1395] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:35.527266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae18a5-cf3b-445a-8e9b-252797dd0b0c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:35.638397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:35.639069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:35.639348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:35.639659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:35.641550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:35.662127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:35.745214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:35.746860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181f5f2-96fb-4a0b-9843-57124d2b87ea service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:35.767187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 714/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:36.363894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34902-030b-4e25-b2c0-72130e78d308 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:36.364421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34902-030b-4e25-b2c0-72130e78d308 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:36.364530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34902-030b-4e25-b2c0-72130e78d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:36.410604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:36.432357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-43d34902-030b-4e25-b2c0-72130e78d308 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:36.433605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-43d34902-030b-4e25-b2c0-72130e78d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:36.521350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 683/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:36.564332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:36.564931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:36.564931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:36.566280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 715/1398] 10.222.0.26 () {54 vars in 943 bytes} [Mon Sep 5 10:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:36.572666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357add6b-a206-41ac-9eb3-c78013df83f4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:36.572953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357add6b-a206-41ac-9eb3-c78013df83f4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:36.573230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357add6b-a206-41ac-9eb3-c78013df83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:36.649068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-357add6b-a206-41ac-9eb3-c78013df83f4 None None] MFA Rules not processed for user `38ca2939be224113a823b0bbba092f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:36.650280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-357add6b-a206-41ac-9eb3-c78013df83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:36.712149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:36.757853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 684/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Mon Sep 5 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:36.767463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:36.769027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:36.906213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf6d1-1750-40dd-a6a6-2eade3a29d4b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:36.916116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:37.021217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:37.021844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:37.022125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:37.022398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:37.024103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:37.111716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:37.113425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8634aa-d31d-45f9-a483-b5a3507caa16 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:37.121521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 716/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:46:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:46:37.850756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:37.851411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:37.851411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:37.852837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 685/1401] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:37.858225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af79b7-b818-457c-b19d-9463e7b37e9a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:37.859288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af79b7-b818-457c-b19d-9463e7b37e9a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:37.859288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af79b7-b818-457c-b19d-9463e7b37e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:37.921639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:37.942214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-44af79b7-b818-457c-b19d-9463e7b37e9a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:37.943445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-44af79b7-b818-457c-b19d-9463e7b37e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:38.071398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 717/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:38.372226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:38.373987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:38.552055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591db450-faa3-440b-93c9-ad53d76d047c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:38.603247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:38.683778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:38.684489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:38.684888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:38.685222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:38.686883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:38.802251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:38.804145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa71d20-205b-4419-86b5-39fd7ef6464a service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:38.825485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 686/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:40.949571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:40.950158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:40.950158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:40.951631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 718/1404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:40.958153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f77ca-3a38-4ae9-9a48-480e14556631 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:40.958664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f77ca-3a38-4ae9-9a48-480e14556631 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:40.958664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f77ca-3a38-4ae9-9a48-480e14556631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:41.042534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:41.053207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-451f77ca-3a38-4ae9-9a48-480e14556631 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:41.071989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-451f77ca-3a38-4ae9-9a48-480e14556631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:41.187058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 687/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:41.513129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:41.514773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:41.643203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:41.681950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0d8c4-33b3-4ec9-b04e-9f776f24c3ad None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:41.817150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:41.817765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:41.818041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:41.818309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:41.820034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:41.920751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:41.932327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:41.936078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010bca-8eb3-42a2-9e7f-38ff0f86e28c service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:41.971366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 719/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:44.038436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:44.039059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:44.039059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:44.044127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 688/1407] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:46:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:46:44.045806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ff49-2a09-4e96-b5f2-8d0a87be7846 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:44.046546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ff49-2a09-4e96-b5f2-8d0a87be7846 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:44.047019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ff49-2a09-4e96-b5f2-8d0a87be7846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:44.133673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1d94ff49-2a09-4e96-b5f2-8d0a87be7846 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:44.134953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1d94ff49-2a09-4e96-b5f2-8d0a87be7846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:44.260825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 720/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:44.557642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:44.559468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:44.709455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:44.738242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d1b4-2f29-4f66-929b-814802dab874 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:44.860140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:44.860803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:44.861191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:44.861527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:44.863179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:44.969065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:44.973778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:44.975450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7b98e-685d-4453-8f7a-b4388d2b3697 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:44.995049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 689/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:54.250490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=74 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:55.033869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=7 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:00.384386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48563-e48c-419b-bfb6-4c426caed757 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:00.384982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48563-e48c-419b-bfb6-4c426caed757 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:00.384982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48563-e48c-419b-bfb6-4c426caed757 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:00.386207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 721/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 5 10:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:00.391831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd902-24fd-4698-9404-27e4cbe5062c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:00.392295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd902-24fd-4698-9404-27e4cbe5062c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:00.392409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd902-24fd-4698-9404-27e4cbe5062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:00.467539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-39dbd902-24fd-4698-9404-27e4cbe5062c None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:00.468896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-39dbd902-24fd-4698-9404-27e4cbe5062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:00.574719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 690/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 5 10:47:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:00.589006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae89f-8ba6-4446-9449-60bb4d059970 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:00.589298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae89f-8ba6-4446-9449-60bb4d059970 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:00.589576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae89f-8ba6-4446-9449-60bb4d059970 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:00.590959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 722/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 5 10:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:00.596106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ebc-5e35-474c-ad04-04ea9650e13b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:00.596410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ebc-5e35-474c-ad04-04ea9650e13b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:00.596714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a19ebc-5e35-474c-ad04-04ea9650e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:00.668383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:00.673216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f1a19ebc-5e35-474c-ad04-04ea9650e13b None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:00.674418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f1a19ebc-5e35-474c-ad04-04ea9650e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:00.787737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 691/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 5 10:47:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:03.160427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:03.161045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:03.161045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:03.162352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:03.167588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025d5-3463-46e1-a768-a4387da942d1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:03.167989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025d5-3463-46e1-a768-a4387da942d1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:03.168132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb025d5-3463-46e1-a768-a4387da942d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:03.234391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cbb025d5-3463-46e1-a768-a4387da942d1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:03.235506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cbb025d5-3463-46e1-a768-a4387da942d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:03.289810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:03.332271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:03.622566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:03.624111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:03.770328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ca8f-558f-45bf-9568-17c70017cfff None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:03.844145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:03.883577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:03.884112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:03.884385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:03.884692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:03.886266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:03.978088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:03.979695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ed7dd-b13d-44f0-a73c-c40386a222db service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:03.997468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 724/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:04.889869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:04.890447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:04.890562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:04.891888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:04.896846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f5a6-fd54-45b1-8e9b-dc670503793e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:04.897291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f5a6-fd54-45b1-8e9b-dc670503793e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:04.897390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f5a6-fd54-45b1-8e9b-dc670503793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:04.975252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b1b2f5a6-fd54-45b1-8e9b-dc670503793e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:04.976449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b1b2f5a6-fd54-45b1-8e9b-dc670503793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:05.003372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:05.073053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:05.228612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:05.230151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:05.373980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eeb8d-0e53-4208-b200-ed07f04863e0 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:05.416648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:05.491693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:05.492230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:05.492510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:05.492811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:05.494404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:05.583908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:05.585511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da21d4-bfbf-4e15-9632-a90cf5f6f711 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:05.603316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 694/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:06.490044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:06.490607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:06.490607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:06.491930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:06.496780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40cca-9793-40ce-b7e0-438873deaadb None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:06.497191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40cca-9793-40ce-b7e0-438873deaadb None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:06.497329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40cca-9793-40ce-b7e0-438873deaadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:06.551907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:06.573492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-acd40cca-9793-40ce-b7e0-438873deaadb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:06.574708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-acd40cca-9793-40ce-b7e0-438873deaadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:06.669168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:47:06.821768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:06.823202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:06.969049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031317b6-c733-40b9-8bb5-f54bdd07cca7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:06.981249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:07.086106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:07.086650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:07.086928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:07.087203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:07.088861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:07.295323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:07.297460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7751bbc-7009-4796-bd9f-e825f8d5c7a6 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:07.316097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 727/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:08.178561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:08.179104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:08.179104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:08.180527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:08.185558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a70a-465f-4b01-ab2f-7ff86ba9e2ee None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:08.185961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a70a-465f-4b01-ab2f-7ff86ba9e2ee None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:08.186104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1a70a-465f-4b01-ab2f-7ff86ba9e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:08.207658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:08.262715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ebf1a70a-465f-4b01-ab2f-7ff86ba9e2ee None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:08.263928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ebf1a70a-465f-4b01-ab2f-7ff86ba9e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:08.358665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:08.512840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:08.514284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:08.623994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:08.659674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a580a-abf7-4a90-b4b2-7dd32cadd4b9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:08.770577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:08.771100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:08.771374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:08.771644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:08.773265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:08.849527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:08.862628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:08.864220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ba00-2fbc-4b88-9f90-57ecfc555fdd service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:08.883455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 697/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:09.743817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:09.744340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:09.744340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:09.745696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:09.750793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29031d-be76-4628-9292-45e13e2d0040 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:09.751218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29031d-be76-4628-9292-45e13e2d0040 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:09.751330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29031d-be76-4628-9292-45e13e2d0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:09.825595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ff29031d-be76-4628-9292-45e13e2d0040 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:09.826794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ff29031d-be76-4628-9292-45e13e2d0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:09.923764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:47:10.075923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:10.078274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:10.162102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:10.224066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0e79-4b25-4624-b829-54d4a89f0dcd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:10.339424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:10.339956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:10.340231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:10.340499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:10.342117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:10.390488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:10.430005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:10.431592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa9c5-be4d-435b-a887-896564281e63 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:10.449889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 730/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:11.308101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:11.308713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:11.308713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:11.310031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:11.314943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bc38-1229-440e-aaca-7d411f4447d9 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:11.315353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bc38-1229-440e-aaca-7d411f4447d9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:11.315484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769bc38-1229-440e-aaca-7d411f4447d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:11.390727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5769bc38-1229-440e-aaca-7d411f4447d9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:11.391938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5769bc38-1229-440e-aaca-7d411f4447d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:11.487718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:11.637792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:11.639320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:11.688753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:11.785110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad35d-e413-476d-b1b7-de7e0698dd73 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:11.900883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:11.901494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:11.901770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:11.902039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:11.903622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:11.910882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:11.995473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:11.997098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221229-d0fb-484e-850b-b309d68e0caf service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:12.015933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 700/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:12.888564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:12.889154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:12.889154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:12.891098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:12.896341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28702-8a3a-4c5b-9934-295a72942357 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:12.896774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28702-8a3a-4c5b-9934-295a72942357 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:12.896926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28702-8a3a-4c5b-9934-295a72942357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:12.975348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-93a28702-8a3a-4c5b-9934-295a72942357 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:12.976559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-93a28702-8a3a-4c5b-9934-295a72942357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:13.043438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:13.072452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:13.224135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:13.225709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:13.243697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:13.371340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448151be-b529-4fc9-b779-d7d5853c6d27 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:13.457876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:13.484428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:13.484745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:13.484994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:13.485274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:13.487681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:13.583215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:13.586529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617c9c3-97e1-40bb-bad0-2eaea0df571c service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:13.603471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 733/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:14.504527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:14.505118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:14.505118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:14.506453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:14.511335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe015b-d1bc-4ace-bb6e-0a3d428eaa3d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:14.511745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe015b-d1bc-4ace-bb6e-0a3d428eaa3d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:14.511888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe015b-d1bc-4ace-bb6e-0a3d428eaa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:14.588637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-acfe015b-d1bc-4ace-bb6e-0a3d428eaa3d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:14.589837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-acfe015b-d1bc-4ace-bb6e-0a3d428eaa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:14.632162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:14.688352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:14.838614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:14.840082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:14.986594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9408f5-753b-49e5-a086-7a506c8e7e5f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:15.039815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:15.098959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:15.099483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:15.099748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:15.100019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:15.101909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:15.189276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:15.190959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25de1-4931-4e57-a781-5e280a2abea7 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:15.209938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 703/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:16.106814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:16.107344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:16.107344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:16.109207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:16.114203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e5184-31b4-4936-ba11-e3aebe2af4ed None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:16.114615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e5184-31b4-4936-ba11-e3aebe2af4ed None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:16.123197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e5184-31b4-4936-ba11-e3aebe2af4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:16.191050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-077e5184-31b4-4936-ba11-e3aebe2af4ed None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:16.192248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-077e5184-31b4-4936-ba11-e3aebe2af4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:16.194281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:16.289155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:16.438922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:16.440688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:16.584798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd71c6-d6ba-4660-bdac-c3d9cb050eb4 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:16.612120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:16.698117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:16.698631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:16.698904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:16.699168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:16.700767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:16.791082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:16.792714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3be0f0-ae0c-4fd2-aabf-c29018439a0b service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:16.811089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 736/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:18.628489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:18.629057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:18.629057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:18.630398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:18.635679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093e18-8e8c-4236-84f4-ab0d623b3733 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:18.636102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093e18-8e8c-4236-84f4-ab0d623b3733 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:18.636215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093e18-8e8c-4236-84f4-ab0d623b3733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:18.679703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:18.705312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-10093e18-8e8c-4236-84f4-ab0d623b3733 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:18.707443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-10093e18-8e8c-4236-84f4-ab0d623b3733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:18.805064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:19.096120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:19.097717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:19.201251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4890d-b98f-402a-a617-d96ffe29008b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:19.233054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:19.276237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:19.276882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:19.277162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:19.277432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:19.279055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:19.387205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:19.388646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd676a-c383-4ec3-a569-d5ccf9ed80c0 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:19.406543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 706/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:21.477591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:21.478122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:21.478122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:21.479494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:21.485389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8770e-04d9-4b09-8501-4e0d0bc25ba1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:21.485819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8770e-04d9-4b09-8501-4e0d0bc25ba1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:21.485921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8770e-04d9-4b09-8501-4e0d0bc25ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:21.551787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d3b8770e-04d9-4b09-8501-4e0d0bc25ba1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:21.553048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d3b8770e-04d9-4b09-8501-4e0d0bc25ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:21.566593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:21.652190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:21.936433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:21.938940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:22.047247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622a6e4-c4e9-4ef2-b700-2d0124b59bed None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:22.059013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:22.120577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:22.121206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:22.121481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:22.121747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:22.123346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:22.230459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:22.231814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff8f-9ef7-4ac3-a8cb-08101c453331 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:22.249284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 739/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:24.524781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:24.525350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:24.525350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:24.526659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:24.531924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e4129-d027-4d91-9152-0bc34cfd164f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:24.532346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e4129-d027-4d91-9152-0bc34cfd164f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:24.532461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e4129-d027-4d91-9152-0bc34cfd164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:24.580128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:24.598309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-638e4129-d027-4d91-9152-0bc34cfd164f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:24.599603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-638e4129-d027-4d91-9152-0bc34cfd164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:24.695044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:24.988753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:24.990285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:25.093620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5347-78ae-4466-a7a0-0eb4768775ee None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:25.132318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:25.168347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:25.168984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:25.169264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:25.169535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:25.171468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:25.279104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:25.281086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3d285-2551-4e1c-8283-abc794d6e67c service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:25.300305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 709/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:27.331023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:27.331634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:27.331634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:27.333162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:27.338448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bae04-86de-4bf0-8470-074d5643aa67 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:27.338830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bae04-86de-4bf0-8470-074d5643aa67 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:27.338992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bae04-86de-4bf0-8470-074d5643aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:27.404041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-792bae04-86de-4bf0-8470-074d5643aa67 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:27.405453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-792bae04-86de-4bf0-8470-074d5643aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:27.426007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:27.502671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:27.790053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:27.791630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:27.894807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0665-b1b3-4109-8f40-f060c708325f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:27.914424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:27.968967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:27.969571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:27.969845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:27.970118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:27.971699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:28.079623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:28.081030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72472d-83f7-4260-ac1d-b4a2f457b6b6 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:28.099945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 742/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:30.053959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:30.054527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:30.054527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:30.055845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:30.061683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7c6f-b5c9-4319-88a9-77223abc78f7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:30.064382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7c6f-b5c9-4319-88a9-77223abc78f7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:30.064382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7c6f-b5c9-4319-88a9-77223abc78f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:30.125831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:30.128568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f71f7c6f-b5c9-4319-88a9-77223abc78f7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:30.129814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f71f7c6f-b5c9-4319-88a9-77223abc78f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:30.226026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:30.511661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:30.513229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:30.618850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f3fc-8308-458e-8497-e52bd86a02cc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:30.669932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:30.694920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:30.695524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:30.695805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:30.696079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:30.697716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:30.806429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:30.807787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e9e0d-f798-44df-8f3d-7bfdb16346ee service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:30.825821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 712/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:32.792922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:32.793487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:32.793487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:32.794810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:32.801576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83034-6540-40a4-af3a-effd0089dd36 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:32.801993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83034-6540-40a4-af3a-effd0089dd36 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:32.802102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a83034-6540-40a4-af3a-effd0089dd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:32.867930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c0a83034-6540-40a4-af3a-effd0089dd36 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:32.869146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c0a83034-6540-40a4-af3a-effd0089dd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:32.897288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:32.965644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:33.253000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:33.254570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:33.357278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad454c-828e-467e-89ae-c96bd47df5d1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:33.385054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:33.429984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:33.430579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:33.430852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:33.431116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:33.432708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:33.541669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:33.543118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4a75c-2836-4f18-a234-8fb6adbbb8fc service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:33.561712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 745/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:35.631434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:35.631989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:35.631989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:35.633358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:35.638478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fe70-bf3e-486b-bad7-9c70daeebbde None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:35.638902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fe70-bf3e-486b-bad7-9c70daeebbde None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:35.639086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fe70-bf3e-486b-bad7-9c70daeebbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:35.705460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1017fe70-bf3e-486b-bad7-9c70daeebbde None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:35.706698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1017fe70-bf3e-486b-bad7-9c70daeebbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:35.715338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:35.804837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:36.087599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:36.089245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:36.193976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5e9f-0202-4821-99b5-4c5ebf993924 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:36.249031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:36.267629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:36.268237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:36.268514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:36.268814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:36.270398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:36.379372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:36.380745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91713c51-37bf-465a-adf3-cd3a04e08277 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:36.399353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 715/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:38.449987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200708e-e013-43bf-bae6-16661333e513 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:38.450588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200708e-e013-43bf-bae6-16661333e513 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:38.450588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200708e-e013-43bf-bae6-16661333e513 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:38.452385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:38.457866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f963eb-ac72-48d5-a31c-17d3c9ccb9b9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:38.458274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f963eb-ac72-48d5-a31c-17d3c9ccb9b9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:38.458405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f963eb-ac72-48d5-a31c-17d3c9ccb9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:38.525660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-69f963eb-ac72-48d5-a31c-17d3c9ccb9b9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:38.526870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-69f963eb-ac72-48d5-a31c-17d3c9ccb9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:38.565206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:38.622534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:38.909487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200708e-e013-43bf-bae6-16661333e513 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:38.911018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c200708e-e013-43bf-bae6-16661333e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:39.016780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200708e-e013-43bf-bae6-16661333e513 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:39.055089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:39.091619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:39.092788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:39.093296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:39.093657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:39.096068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:39.214992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:39.216370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b44c2-bdae-4a19-a610-932c27dc8f40 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:39.235734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 748/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:41.247795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:41.248955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:41.248955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:41.251063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:41.256995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6b92-28e6-4334-9b63-b00d71e45c18 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:41.257476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6b92-28e6-4334-9b63-b00d71e45c18 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:41.257597 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6b92-28e6-4334-9b63-b00d71e45c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:41.325890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a7ff6b92-28e6-4334-9b63-b00d71e45c18 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:41.327748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a7ff6b92-28e6-4334-9b63-b00d71e45c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:41.346519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:41.428463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:41.711815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:41.713423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:41.823280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b01b-3529-4f39-ab20-7f8f88b4e843 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:41.890639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:41.897057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:41.897659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:41.897935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:41.898208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:41.899795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:42.009095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:42.010559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d72112-9156-4235-8605-5aa0f09725f4 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:42.028530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 718/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:43.933445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:43.933978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:43.933978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:43.935383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:47:43.940878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32942a9-a118-4548-9c83-af82cbe6b5ab None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:43.941321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32942a9-a118-4548-9c83-af82cbe6b5ab None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:43.941418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32942a9-a118-4548-9c83-af82cbe6b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:44.009094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f32942a9-a118-4548-9c83-af82cbe6b5ab None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:44.010222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f32942a9-a118-4548-9c83-af82cbe6b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:44.059080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:44.106893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:44.392057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:44.393633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:44.494660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec835c-67a1-4609-b402-9e99286c7f47 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:44.541034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:44.567376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:44.567989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:44.568343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:44.568640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:44.570281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:44.678036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:44.679481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6f62-16d4-44bf-abca-bbd867dac80f service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:44.698151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 751/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:54.125010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=22 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:54.695831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=66 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:04.267250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0386e-2447-4f5a-bc16-38c465c4a660 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:04.267827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0386e-2447-4f5a-bc16-38c465c4a660 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:04.267827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0386e-2447-4f5a-bc16-38c465c4a660 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:04.269171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 720/1471] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:04.274399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905e98-5c72-43ae-bdf8-d15fda8b9534 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:04.274839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905e98-5c72-43ae-bdf8-d15fda8b9534 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:04.274973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905e98-5c72-43ae-bdf8-d15fda8b9534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:04.341443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ed905e98-5c72-43ae-bdf8-d15fda8b9534 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:04.342657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ed905e98-5c72-43ae-bdf8-d15fda8b9534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:04.437408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 752/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:04.739810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:04.740097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:04.740376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:04.741797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 721/1473] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 5 10:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:04.746626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4829-19d9-4f6a-b2b0-fa6b0ede9721 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:04.746911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4829-19d9-4f6a-b2b0-fa6b0ede9721 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:04.747248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4829-19d9-4f6a-b2b0-fa6b0ede9721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:04.822114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a16a4829-19d9-4f6a-b2b0-fa6b0ede9721 None None] MFA Rules not processed for user `b0c38e0197d54850803f0cf9a3419dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:04.823307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a16a4829-19d9-4f6a-b2b0-fa6b0ede9721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:04.844520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:04.900357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 753/1474] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 5 10:48:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:04.908838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:04.910381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:05.018581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918c34-7f26-47ad-99b2-176fbd924714 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:05.094975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:05.095573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:05.095849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:05.096115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:05.097732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:05.151687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:05.206106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:05.207813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756164bc-c33b-4311-9af6-4ed1b8a074d2 service glance] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:05.225914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 722/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:07.229157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ba785-40fd-494d-8356-388162f94e85 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:07.229765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ba785-40fd-494d-8356-388162f94e85 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:07.229765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ba785-40fd-494d-8356-388162f94e85 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:07.231009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 754/1476] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:07.236876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad4f9-213d-4353-a315-163fb4a25772 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:07.237292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad4f9-213d-4353-a315-163fb4a25772 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:07.237416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaad4f9-213d-4353-a315-163fb4a25772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:07.301613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-abaad4f9-213d-4353-a315-163fb4a25772 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:07.302982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-abaad4f9-213d-4353-a315-163fb4a25772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:07.400186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 723/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:07.674523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ba785-40fd-494d-8356-388162f94e85 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:07.676094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-605ba785-40fd-494d-8356-388162f94e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:07.799695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ba785-40fd-494d-8356-388162f94e85 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:07.848501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:07.893016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:07.893623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:07.893899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:07.894164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:07.894800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:07.896516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:48:07.896516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:48:07.896516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:48:07.897679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fd190-a648-4104-ba1d-03aabf6aeef1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:07.916355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 755/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 5 10:48:07 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:48:09.843936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:09.844488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:09.844488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:09.845747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 724/1479] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:09.851023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116268-22ab-4697-9937-07b18bda5938 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:09.851409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116268-22ab-4697-9937-07b18bda5938 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:09.851628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116268-22ab-4697-9937-07b18bda5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:09.922196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5b116268-22ab-4697-9937-07b18bda5938 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:09.923417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5b116268-22ab-4697-9937-07b18bda5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:10.020746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 756/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:10.313212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:10.314766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:10.324497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:10.577931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6091-9c4d-4791-86a9-f36f5bec45fe None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:10.658664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:10.692438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:10.693085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:10.693360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:10.693633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:10.695233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:10.784677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:10.786263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99af93-5395-4269-ba35-315f13d19541 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:10.804540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 725/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:12.889309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:12.889875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:12.889875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:12.891201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 757/1482] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:12.896553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c8c9-58b4-4e85-8ef6-da863d1fb145 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:12.896990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c8c9-58b4-4e85-8ef6-da863d1fb145 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:12.897112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c8c9-58b4-4e85-8ef6-da863d1fb145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:12.964021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3278c8c9-58b4-4e85-8ef6-da863d1fb145 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:12.965270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3278c8c9-58b4-4e85-8ef6-da863d1fb145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:13.012480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:13.065415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 726/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:48:13.352390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:13.353987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:13.377660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:13.457832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15e199-71c7-4e67-932c-a9b8fbd4aadf None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:13.531332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:13.532016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:13.532290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:13.532557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:13.534179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:13.612028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:13.646466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:13.647910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5c0b8-90e7-43f1-914c-8cbc237ae4c6 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:13.665995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 758/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:15.626946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:15.627466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:15.627466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:15.628777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 727/1485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:48:15.634144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215664de-8387-41e9-84a9-c6d4fdf76617 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:15.634525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215664de-8387-41e9-84a9-c6d4fdf76617 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:15.634689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215664de-8387-41e9-84a9-c6d4fdf76617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:15.701337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-215664de-8387-41e9-84a9-c6d4fdf76617 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:15.706643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-215664de-8387-41e9-84a9-c6d4fdf76617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:15.804638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 759/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:16.093628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:16.095522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:16.197854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e56ac-1e65-4935-ae07-aaf9c3801ba8 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:16.269499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:16.271177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:16.271780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:16.272055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:16.272322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:16.273936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:16.381645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:16.383062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0d85-159c-4b02-8b80-c30ab7fe969d service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:16.400507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 728/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:18.403792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:18.404362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:18.404497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:18.405886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 760/1488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:18.411150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56afc-ff4f-42a6-b6fc-6772e5628fe8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:18.411568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56afc-ff4f-42a6-b6fc-6772e5628fe8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:18.411804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56afc-ff4f-42a6-b6fc-6772e5628fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:18.477326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dbc56afc-ff4f-42a6-b6fc-6772e5628fe8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:18.478536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dbc56afc-ff4f-42a6-b6fc-6772e5628fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:18.531791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:18.577257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 729/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:18.882272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:18.883829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:18.920652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:19.036124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dea64-d299-4c86-8f55-53b3b6e9088d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:19.065725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:19.068308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:19.068308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:19.068308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:19.068630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:19.147650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:19.176050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:19.177528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5945ead-eadb-44db-a427-15ab6cc6cda9 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:19.196007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 761/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:21.468051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:21.468679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:21.468679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:21.469965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 730/1491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 5 10:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:48:21.475412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70abfa7-3b7b-4659-80c4-d700b95c3dca None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:21.475840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70abfa7-3b7b-4659-80c4-d700b95c3dca None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:21.475942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70abfa7-3b7b-4659-80c4-d700b95c3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:21.542106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f70abfa7-3b7b-4659-80c4-d700b95c3dca None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:21.543933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f70abfa7-3b7b-4659-80c4-d700b95c3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:21.641602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 762/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 5 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:21.947812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:21.949921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:22.053292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d759-70ed-4f10-8842-bbcd053889ab None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:22.125900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:22.126536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:22.126810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:22.127075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:22.128780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:22.138354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:22.237508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:22.238853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dce09b-add7-4c99-a57b-703e0e68860a service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:22.256392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 731/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:31.639761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=82 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:32.254184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=50 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:07.243935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:07.245309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:07.245624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:07.323868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:50:07.325119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:07.422288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 763/1494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:50:07.430440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:07.430935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:07.431042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:07.508666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:50:07.510390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:07.604746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 732/1495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:50:07.609428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:07.610709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:07.622599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadff289-75fb-495b-881a-29f6faeaeb30 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:07.683623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:07.716607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:07.717219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:07.717492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:07.717774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:07.718395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:50:07.718690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:07.719762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:07.719762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:50:07.719762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:50:07.720662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:07.732860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 764/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:50:07.741390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:07.751817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dedd-fcd1-444c-97c2-95b8a1754716 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:07.814365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:07.853172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:07.854277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:07.854552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:07.854814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:07.855431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:07.857180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:07.857180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:50:07.857180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:50:07.858362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:08.014155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 733/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:50:07 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:50:08.018333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:08.019837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:08.053854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2ca2-46f4-4c63-9623-d88be8031506 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:08.152403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:50:08.155415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:50:08.156378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:08.254345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 765/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:50:08 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:50:08.258607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:08.260358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:08.328573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0420b6-e26a-4f0c-901a-3afe71c3c015 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:08.413031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:08.423250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:08.423847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.424117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.424380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.425040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:08.426037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:08.426037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:50:08.426037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:50:08.426962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:08.439299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 734/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:50:08.443356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:08.444908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:08.458268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13b51-2ca8-4278-a487-c035fa75f9c8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:08.484045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:08.553958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:08.554568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.554843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.555111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.555745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:08.556817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:08.556817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:50:08.556817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:50:08.557707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37d728-b1bb-4bac-93e4-eb29caef92f5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:08.570155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 766/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:50:08.574546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:08.576187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:08.609913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a2bdd-0f64-4a24-a113-9581068bccd9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:08.702983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:08.703561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.703837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.704107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] PATH_INFO: `/v3/projects/259d6c0b54ae4865a2d4c6c419f70a33/users/3306641928d9435e93f9c1d53dbf0f20/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.726829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] RBAC: Authorizing `identity:create_grant(project_id=259d6c0b54ae4865a2d4c6c419f70a33, user_id=3306641928d9435e93f9c1d53dbf0f20, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:08.727856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:08.727856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:50:08.727856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:50:08.730443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd7b9f-20af-4b8e-98ce-98057bcf085a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:08.818062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 735/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:50:08 2022] PUT /identity/v3/projects/259d6c0b54ae4865a2d4c6c419f70a33/users/3306641928d9435e93f9c1d53dbf0f20/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:50:08.830546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793380ff-8667-4537-8c57-10c4d64aa248 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.830872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793380ff-8667-4537-8c57-10c4d64aa248 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.831260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793380ff-8667-4537-8c57-10c4d64aa248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.889025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-793380ff-8667-4537-8c57-10c4d64aa248 None None] MFA Rules not processed for user `3306641928d9435e93f9c1d53dbf0f20`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:50:08.890242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-793380ff-8667-4537-8c57-10c4d64aa248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:08.967461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 767/1502] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:50:08.981136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.981426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.981703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:08.983067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 736/1503] 10.222.0.26 () {54 vars in 964 bytes} [Mon Sep 5 10:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:50:08.987760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e727-9661-4997-a345-75ce5cf240d2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:08.988038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e727-9661-4997-a345-75ce5cf240d2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:08.988304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e727-9661-4997-a345-75ce5cf240d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:09.018679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:09.062816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2834e727-9661-4997-a345-75ce5cf240d2 None None] MFA Rules not processed for user `e7dce5cc34ce4930ade1d9ba9e3bddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:50:09.064010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2834e727-9661-4997-a345-75ce5cf240d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:09.138401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 768/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Sep 5 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:50:09.146018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:09.147571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:09.198585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:09.251454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c79bd-765e-4506-88bb-720c5e9ebd93 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:09.324196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:09.324883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:09.325166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:09.325438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:09.327012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:09.425026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:09.426448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:09.429872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:09.444012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 737/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:50:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:50:09.490504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bd6f7-f89a-4c95-ae26-48c15aae0f33 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:09.490960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bd6f7-f89a-4c95-ae26-48c15aae0f33 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:09.491058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bd6f7-f89a-4c95-ae26-48c15aae0f33 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:09.492331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 769/1506] 10.222.0.26 () {52 vars in 830 bytes} [Mon Sep 5 10:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:50:09.496486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:09.497730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:09.597606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb080e4-c1ff-499d-a1fc-146e46193631 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:09.693082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:09.693707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:09.694238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:09.694510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] PATH_INFO: `/v3/users/3306641928d9435e93f9c1d53dbf0f20` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:09.706907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3306641928d9435e93f9c1d53dbf0f20)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:09.708205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:09.708205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:50:09.708205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:50:09.709505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:09.719383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:09.940051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3306641928d9435e93f9c1d53dbf0f20'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:09.940606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3306641928d9435e93f9c1d53dbf0f20'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:09.957935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3306641928d9435e93f9c1d53dbf0f20'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:09.959010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3306641928d9435e93f9c1d53dbf0f20'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:09.982192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3306641928d9435e93f9c1d53dbf0f20'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:10.057234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 738/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:50:09 2022] DELETE /identity/v3/users/3306641928d9435e93f9c1d53dbf0f20 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:50:10.061863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:10.062156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:10.062437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:10.121268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:50:10.122491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:10.200287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:10.211910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 770/1508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:50:10.229869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:10.231123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:10.337431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a828-90b4-4b75-8f8b-700cebf7d5d8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:10.392309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:10.411130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:10.411729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:10.412001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:10.412264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:10.413921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:10.523406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:10.524781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3796b-0b6b-4a62-8e7f-4f92ae17c586 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:10.543148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 739/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:50:11.060218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:50:11.061481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:50:11.073634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7863-5a28-4d93-8474-09467231cda0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:50:11.176836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:50:11.177467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:50:11.177743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:50:11.178012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] PATH_INFO: `/v3/projects/259d6c0b54ae4865a2d4c6c419f70a33` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:50:11.187828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259d6c0b54ae4865a2d4c6c419f70a33)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:50:11.188904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:50:11.188904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:50:11.188904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:50:11.190098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:50:11.320476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259d6c0b54ae4865a2d4c6c419f70a33', 'request_id': 'req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:11.326593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259d6c0b54ae4865a2d4c6c419f70a33', 'request_id': 'req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:11.412061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259d6c0b54ae4865a2d4c6c419f70a33', 'request_id': 'req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:11.442077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] The token cache is being invalidate because project 259d6c0b54ae4865a2d4c6c419f70a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:50:11.442370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:11.442963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7fdbcfdf-f733-4807-b6b9-a3aa461761b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:50:11.444278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 771/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:50:11 2022] DELETE /identity/v3/projects/259d6c0b54ae4865a2d4c6c419f70a33 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:50:20.541128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=62 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:21.439954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:51:38.629257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:38.629874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:38.629874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:38.632371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:38.637306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940850-e96a-4109-9334-f65b3ce013f9 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:38.637720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940850-e96a-4109-9334-f65b3ce013f9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:38.637939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940850-e96a-4109-9334-f65b3ce013f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:38.719983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d0940850-e96a-4109-9334-f65b3ce013f9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:38.721129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d0940850-e96a-4109-9334-f65b3ce013f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:38.826048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:38.979631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:38.981724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:39.100088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe70eb-5c91-4374-a487-a2be515c2219 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:39.105578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:39.106180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:39.106457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:39.106726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:39.115238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:39.116845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861d0dd-ff45-4f2a-b5ef-5699128b740c service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:39.126043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 741/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:51:39.965211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d74b-858b-4899-9883-3e72e3506920 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:39.965676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d74b-858b-4899-9883-3e72e3506920 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:39.965796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d74b-858b-4899-9883-3e72e3506920 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:39.967096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:39.972050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ff54-f4c1-4e2d-b6a4-6f659d985219 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:39.972475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ff54-f4c1-4e2d-b6a4-6f659d985219 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:39.972582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1ff54-f4c1-4e2d-b6a4-6f659d985219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:39.992366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-14c1ff54-f4c1-4e2d-b6a4-6f659d985219 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:39.993595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-14c1ff54-f4c1-4e2d-b6a4-6f659d985219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:40.001427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:40.154613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429d74b-858b-4899-9883-3e72e3506920 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:40.169442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429d74b-858b-4899-9883-3e72e3506920 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:40.174926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:40.175531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:40.175811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:40.176085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:40.184611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:40.186216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056de67-89a3-47e3-b73d-82ae77e14f36 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:40.196027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 774/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:51:40.830713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be930c69-4188-482b-a234-b6ac5e5fda27 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:40.830991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be930c69-4188-482b-a234-b6ac5e5fda27 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:40.831265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be930c69-4188-482b-a234-b6ac5e5fda27 None None] PATH_INFO: `/v3` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:40.832551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 743/1517] 10.222.0.40 () {54 vars in 925 bytes} [Mon Sep 5 10:51:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:51:40.839107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015d9-1a49-4fd0-9db8-c7d9b1030eff None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:40.839396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015d9-1a49-4fd0-9db8-c7d9b1030eff None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:40.839676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015d9-1a49-4fd0-9db8-c7d9b1030eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:40.900953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-84e015d9-1a49-4fd0-9db8-c7d9b1030eff None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:40.902140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-84e015d9-1a49-4fd0-9db8-c7d9b1030eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:40.919049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:51:40.972805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 775/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Sep 5 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:45.010856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831509-110c-4117-b4b2-c045224b6b7b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:45.011366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831509-110c-4117-b4b2-c045224b6b7b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:45.011467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831509-110c-4117-b4b2-c045224b6b7b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:45.012818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 744/1519] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 5 10:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:45.017788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9603af-2f50-4bf1-a008-c0cabc5345c9 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:45.018252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9603af-2f50-4bf1-a008-c0cabc5345c9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:45.018353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9603af-2f50-4bf1-a008-c0cabc5345c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:45.040099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-fc9603af-2f50-4bf1-a008-c0cabc5345c9 None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:45.041338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fc9603af-2f50-4bf1-a008-c0cabc5345c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:45.049754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 776/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 5 10:51:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:45.057348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831509-110c-4117-b4b2-c045224b6b7b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:45.070422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831509-110c-4117-b4b2-c045224b6b7b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:45.075312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:45.076053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:45.076336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:45.076626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:45.085477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:45.087062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f1a5c-770d-4416-9656-51eafcab2e3b service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:45.096696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 745/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:51:51.446882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b48a6-3321-4c4b-8725-016cb26b5c57 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:51.447491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b48a6-3321-4c4b-8725-016cb26b5c57 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:51.447491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b48a6-3321-4c4b-8725-016cb26b5c57 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:51.448823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:51.453640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ca15-cbb8-413e-ba68-477ccb8af6a8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:51.454071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ca15-cbb8-413e-ba68-477ccb8af6a8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:51.454261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ca15-cbb8-413e-ba68-477ccb8af6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:51.474915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2c11ca15-cbb8-413e-ba68-477ccb8af6a8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:51.476135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2c11ca15-cbb8-413e-ba68-477ccb8af6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:51.484182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:51.642119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b48a6-3321-4c4b-8725-016cb26b5c57 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:51.650534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b48a6-3321-4c4b-8725-016cb26b5c57 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:51.655960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604a425-357f-4c0f-a805-621664055965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:51.656564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a425-357f-4c0f-a805-621664055965 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:51.656868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a425-357f-4c0f-a805-621664055965 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:51.657137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a425-357f-4c0f-a805-621664055965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:51.665646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604a425-357f-4c0f-a805-621664055965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:51.667294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604a425-357f-4c0f-a805-621664055965 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:51.677249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 778/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:51:52.497469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296f7-30f8-4a0a-aba1-2bb27bc277ee None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:52.498037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296f7-30f8-4a0a-aba1-2bb27bc277ee None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:52.498037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c296f7-30f8-4a0a-aba1-2bb27bc277ee None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:52.499385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:51:52.504106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244dab-0d31-4e5a-be71-5316eec744ea None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:52.504528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244dab-0d31-4e5a-be71-5316eec744ea None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:52.504691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244dab-0d31-4e5a-be71-5316eec744ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:52.524260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2e244dab-0d31-4e5a-be71-5316eec744ea None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:52.525550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2e244dab-0d31-4e5a-be71-5316eec744ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:52.533403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:52.688710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c296f7-30f8-4a0a-aba1-2bb27bc277ee None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:52.703752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c296f7-30f8-4a0a-aba1-2bb27bc277ee None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:52.710351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:52.710944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:52.711226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:52.711489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:52.719524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:52.721127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668fc2d-a29a-4697-94ff-d64825aa4ce5 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:52.730428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 748/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:51:56.545270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:56.545841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:56.545841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:56.547176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:56.553186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d7f8-3d20-4e9e-85a9-001fa24b94e3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:56.553584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d7f8-3d20-4e9e-85a9-001fa24b94e3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:56.558013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d7f8-3d20-4e9e-85a9-001fa24b94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:56.573385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-94a6d7f8-3d20-4e9e-85a9-001fa24b94e3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:56.574602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-94a6d7f8-3d20-4e9e-85a9-001fa24b94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:56.582513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:56.867334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:56.869103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:56.948416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f0aca-25de-441e-9e6f-c48b3e3fd7e6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:56.952151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:56.952795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:56.953570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:56.953570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:56.963678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:56.965197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd237d-a5ee-415f-987b-fbeb64198981 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:56.975800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 781/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:51:58.875573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3715-de49-4c0e-95b9-fad3ccdea439 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:58.876177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3715-de49-4c0e-95b9-fad3ccdea439 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:58.876177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3715-de49-4c0e-95b9-fad3ccdea439 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:58.877493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:51:58.884174 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e3fa-7a46-4056-9a50-2ae3f6d209ca None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:58.884678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e3fa-7a46-4056-9a50-2ae3f6d209ca None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:58.884789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e3fa-7a46-4056-9a50-2ae3f6d209ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:58.904430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e880e3fa-7a46-4056-9a50-2ae3f6d209ca None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:51:58.905670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e880e3fa-7a46-4056-9a50-2ae3f6d209ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:51:58.913586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:51:59.198753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d3715-de49-4c0e-95b9-fad3ccdea439 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:51:59.210047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d3715-de49-4c0e-95b9-fad3ccdea439 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:51:59.213585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:51:59.214462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:51:59.214918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:51:59.215407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:51:59.227815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:51:59.229279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b70b7-d42c-4eb1-8fbc-256740304d87 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:51:59.239615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 751/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:52:02.627378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:02.627920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:02.627920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:02.629953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:52:02.635172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db3da-3d81-478e-8a1b-687b0b22c134 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:02.635593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db3da-3d81-478e-8a1b-687b0b22c134 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:02.635740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db3da-3d81-478e-8a1b-687b0b22c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:02.643340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=81 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:52:02.656745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8b0db3da-3d81-478e-8a1b-687b0b22c134 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:52:02.657947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8b0db3da-3d81-478e-8a1b-687b0b22c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:02.666113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:52:03.216800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:52:03.218487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:03.282336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:52:03.295567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323afb-66e3-49af-b283-fd71a62374a6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:52:03.299306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:52:03.299914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:03.300271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:03.300541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:03.310026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:52:03.311586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9fe82-48ca-49ae-89ec-ee5910afcc83 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:52:03.321229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 784/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:52:05.220939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:05.221496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:05.221496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:05.223383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:52:05.228576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e0fb-9b40-402b-9179-2f4c1091b61f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:05.229049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e0fb-9b40-402b-9179-2f4c1091b61f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:05.229149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7e0fb-9b40-402b-9179-2f4c1091b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:05.249212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-44a7e0fb-9b40-402b-9179-2f4c1091b61f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:52:05.250417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-44a7e0fb-9b40-402b-9179-2f4c1091b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:05.258858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:52:05.815867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:52:05.818375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:05.831325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee10e3-2213-4ede-b4da-a11e99320fa6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:52:05.835445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:52:05.836073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:05.836372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:05.836681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:05.845753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:52:05.847103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ea679-a854-4d10-878b-a001274e8c6b service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:52:05.856458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 754/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:52:15.244349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=11 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:52:15.852378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=8 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:29.254951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.255579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.255579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.287503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.288759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.297377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 786/1540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:29.306816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa2a6-afde-444a-8c4b-d89743be5295 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.307895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa2a6-afde-444a-8c4b-d89743be5295 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.308402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa2a6-afde-444a-8c4b-d89743be5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.346113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-744aa2a6-afde-444a-8c4b-d89743be5295 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.347790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-744aa2a6-afde-444a-8c4b-d89743be5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.361501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 755/1541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:29.366575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.381301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be472285-e3e1-40f1-8df1-81e5b330620d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.384430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149c84-0a7c-4585-bb11-376da975d824 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.385008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149c84-0a7c-4585-bb11-376da975d824 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.385515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149c84-0a7c-4585-bb11-376da975d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.386110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.386743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.387018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.387289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.387944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:29.388241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.392023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.408961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 787/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:29.411545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e4149c84-0a7c-4585-bb11-376da975d824 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.418158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e4149c84-0a7c-4585-bb11-376da975d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.427535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 756/1543] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:29.432223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.437070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.438157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.438851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.447282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62155-8a26-441d-806a-44459ebdab4f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.470238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.470778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.470917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.471145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.471414 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.472072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.473179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:29.473179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:53:29.473179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:53:29.474486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c23cc8-ade6-4bd1-a914-d615e38f8b61 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.478355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.497307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 757/1544] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:29.502543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.517145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09ea29-cb51-4f2f-b715-055d55268df3 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.530937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.531597 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.531873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.532139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.532863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:29.533365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.534679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:29.534679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:53:29.534679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:53:29.535890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.555106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 758/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:53:29.562860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.583857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f08b1-1f84-4f02-82c7-9ed1663c7cf2 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.590365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.590989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.591268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.591540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.592186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.594598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6414a9-7fa7-4381-acb0-827bc04d6188 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.642031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 788/1546] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/projects => generated 403 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:29.643387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.643674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.643945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.677971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.695421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.752706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 789/1547] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.757685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.770888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c881-374a-422c-a0b7-34c8637a6a7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.776751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.777507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.777798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.778125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.778929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.780882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbf5fa-4dee-4c76-b3d9-b438c31b24c4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.800700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 759/1548] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:53:29.802991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1d0-853e-440e-99dd-7ba606387452 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.803278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1d0-853e-440e-99dd-7ba606387452 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.803546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233c1d0-853e-440e-99dd-7ba606387452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.823309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4233c1d0-853e-440e-99dd-7ba606387452 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.824512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4233c1d0-853e-440e-99dd-7ba606387452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.883977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 760/1549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.885415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f14-cf8b-468f-a6ee-5deb661085e6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.885705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f14-cf8b-468f-a6ee-5deb661085e6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.885982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f14-cf8b-468f-a6ee-5deb661085e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.899901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 790/1550] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/users => generated 302 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:29.904508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208e9ab-76b2-408b-bfa3-51221728fca1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.904508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208e9ab-76b2-408b-bfa3-51221728fca1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.904508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208e9ab-76b2-408b-bfa3-51221728fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.907333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ee7f5f14-cf8b-468f-a6ee-5deb661085e6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.908560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ee7f5f14-cf8b-468f-a6ee-5deb661085e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.916680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 761/1551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.918763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.919280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.919706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.921539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5208e9ab-76b2-408b-bfa3-51221728fca1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.922890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5208e9ab-76b2-408b-bfa3-51221728fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.931027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 791/1552] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.933953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9d06-022d-4ade-85d8-9dade3e56a44 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.934236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9d06-022d-4ade-85d8-9dade3e56a44 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.934515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf9d06-022d-4ade-85d8-9dade3e56a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.943626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.944888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.957611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0cdf9d06-022d-4ade-85d8-9dade3e56a44 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.959113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0cdf9d06-022d-4ade-85d8-9dade3e56a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:29.960064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 762/1553] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.960945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:29.967967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 792/1554] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:29.969600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4fb8-8111-46e1-9d9a-6a80e9b95e29 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.969868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4fb8-8111-46e1-9d9a-6a80e9b95e29 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.970143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c4fb8-8111-46e1-9d9a-6a80e9b95e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.970757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d2252-86f9-49fa-a1dc-69cb6d05ba33 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:29.975556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:29.976155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:29.976429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:29.976727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:29.977384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:29.978395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:29.978395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:53:29.978395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:53:29.979599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7cf34-ffd2-453d-b113-863a041fb234 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:29.991763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-459c4fb8-8111-46e1-9d9a-6a80e9b95e29 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:29.996223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-459c4fb8-8111-46e1-9d9a-6a80e9b95e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.001454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 793/1555] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.002596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.002926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.003134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.029537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:30.029537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.031747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 794/1556] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.032493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.041340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39acde-230f-4d82-aa30-edf8a89100cc None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.045840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.046422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.046699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.047001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.047634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.049283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8db47a-93c7-4ced-a752-3458ee4b88b4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.058915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 795/1557] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:30.060124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd771-42fb-43be-8e72-2b6476e6389c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.060399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd771-42fb-43be-8e72-2b6476e6389c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.060687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedd771-42fb-43be-8e72-2b6476e6389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.080679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bbedd771-42fb-43be-8e72-2b6476e6389c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:30.081877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bbedd771-42fb-43be-8e72-2b6476e6389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.089904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 796/1558] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.091165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.091453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.091730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.109997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:30.111158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.119239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 797/1559] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.120118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.129918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603af86-50b4-4fcb-8826-dfb5e5da81e8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.149884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.149884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.149884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.149884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b9f58-409c-4cf1-a948-4a00fb835397 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 798/1560] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.157469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.157991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.170680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:30.171885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.174481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 763/1561] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:29 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.175724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.176014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.176293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.181710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 799/1562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.182625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.192809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139434e3-f99d-4aa8-97e2-bfda643cd606 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.197464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.198055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.198339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.198613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.199253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.199553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.199720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:30.200981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:30.201187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.210354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 764/1563] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:30.211139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.221196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 800/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.221196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.221472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9274b21-5b78-4674-8743-c856af5468d9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.225845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.235910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.235910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.235910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.235910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.235910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.236381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c9add-05b9-4849-b9f6-d34fefc60b5d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.237119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.237718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.238003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.238276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.238914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.239249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.240183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 765/1565] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:30.241010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.241130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.243973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:30.251452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfddec-370a-4515-9afa-5017823cc481 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.255481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 801/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.256427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.257242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.257842 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.258127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.258410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.259093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.259400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.261176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.268515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd898-61e3-47d0-b89b-dd50e8d3db89 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.273926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.274355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 766/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.275343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.280920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.281244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.281566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.282437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.284425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.286021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272070-f144-4804-a484-7cd6d26d6fa4 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.290678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.291269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.291545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.291813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.292447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.294056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.304433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 767/1568] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:30.305252 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.315549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f4ec-a06f-4e8e-ade9-42f5e649cc6c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.320098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.320750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.321033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.321298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.321921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.322219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.323801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.335820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 768/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.336617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.345711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a8e-9102-4da4-9829-6806641df69f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.350208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.350766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.351040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.351323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.351917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:30.352212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.353783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.365655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 769/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:30.376024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.376154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb179-becd-4bfa-b5f5-d8253145bf41 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.380884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.381447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.381725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.381993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.382601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.384447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.388857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:30.402523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 802/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.405479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.464249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4f71c-d183-43ca-9665-fddad7fa0486 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.470104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.470762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.471063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.474224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] PATH_INFO: `/v3/projects/755d795adee340bebf8742d6e0c3bf53/users/89cec48cc9904fa09a1921196e678e8f/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.486632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=755d795adee340bebf8742d6e0c3bf53, user_id=89cec48cc9904fa09a1921196e678e8f, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.487677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:30.487677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:53:30.487677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:53:30.489654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.501756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 770/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.507417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.561783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069594d-c783-480b-a0bd-88dceb4bec3a admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.567356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.567955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.568227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.568495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.569144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.571022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.613802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 803/1573] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:30 2022] PUT /identity/v3/projects/755d795adee340bebf8742d6e0c3bf53/users/89cec48cc9904fa09a1921196e678e8f/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:30.614639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.678809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffd301-ce63-42a5-9794-f20a22add3fd admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.684290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.685047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.685434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.685846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.686564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.688803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.710810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 771/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.710810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.769789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c3358-7555-4128-946a-4fb634feb530 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.774529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.775131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.775409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.775679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.776316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.777996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.788326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 772/1575] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:30.795047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.799195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa729d6-cbc8-477f-98fa-6aa38c545db8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.803749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.804324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.804618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.804901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.805542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.807441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.831410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 804/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.831410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.874968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:30.891901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10890-813e-4ba5-a789-7fb9de035fce admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:30.896856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:30.897479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:30.897742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:30.898038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:30.898668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:30.900647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:30.934958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 773/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:30.935893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:30.986511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:31.002377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7f6f-4a8a-488d-8164-99120ccb52bb admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.008104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.008743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.009024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.009288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.009913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.011813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c27f58-846c-4910-a1b5-0deedaee4cdf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.049488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 805/1578] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.050296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.118211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09b00-3a34-40e9-8f5d-8490de674a22 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.122712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.128140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.128140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.128140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.128140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.128140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.146176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 774/1579] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:30 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.147559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.147939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.148243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.167727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:31.168957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:31.176708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 775/1580] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:31.177439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.186435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be01a4c-1eaa-4099-94b4-c88678ee7ae0 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.191049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.191607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.191911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.192180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.192841 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.194720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.259417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 806/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.260407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.271482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607c6f-393c-491e-b263-f6dbd36a5529 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.276972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.277606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.277884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.278155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] PATH_INFO: `/v3/projects/80137f0c580e46d990b8bd7df0aa6e1a/users/aa80a09a986646ab98a5cfdac813bd8d/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.296789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80137f0c580e46d990b8bd7df0aa6e1a, user_id=aa80a09a986646ab98a5cfdac813bd8d, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.299507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.348824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 776/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.348824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.357388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cd6-98d0-4a13-8165-09f42a32de9b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.362210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.362799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.363075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.363345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.363963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.365908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.410822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 807/1583] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:31 2022] PUT /identity/v3/projects/80137f0c580e46d990b8bd7df0aa6e1a/users/aa80a09a986646ab98a5cfdac813bd8d/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:31.411639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.478063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a30d-aacf-4210-a99c-3c2e3412e7c9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.483062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.484189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.485000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.485232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.486153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.488466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.493992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 777/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.499768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.508666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2380f-647b-495c-b4a6-642dbc255c25 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.513388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.513986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.514264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.514534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.515157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.517988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.589941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 808/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.590773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.602544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc282dc-c399-42c2-983c-dc93cb6375ee admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.607107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.607688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.607966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.608234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.608894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.611066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.620051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 778/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:31.626058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.626188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 809/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.626188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.637820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd2469-951e-47c3-a3c6-9fc7fa606d55 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.643461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.644009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.644359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.644742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.645558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.647279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.653068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:31.660379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 810/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.660941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.671601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1c9a-c5b9-49cf-b5f5-88a4ecd7269b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.676964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.677563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.677838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.678112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.678746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.680679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3e5f6-8c7b-483c-a44a-71cbed66eac8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.682095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1da4b-1085-4487-b757-e6ea03b83c3d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.685992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.689033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.689033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.689033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.690792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 811/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.692027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.692367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.692666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.697471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.698976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.711350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 779/1590] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:31.716567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.716722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:31.716722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:31.722335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855e034-b1af-49c3-867b-335fe877d0bf service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.724169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 812/1591] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:31.727664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.731842 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.732748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.738249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.738249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.738249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.738249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.744187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabbcd-96fe-4406-8257-d35bcd7c5973 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.747047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 780/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.747896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.749245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.750306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.751005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.751432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.752477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.754549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.758100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b0e6-25d8-44f4-8fdb-500a2feb40eb admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.762861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.766750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.766750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.766750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.766750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.767299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 813/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.767382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.767857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.780189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 781/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.780367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3681-1f53-4f31-b3b8-c9a0ea60ef5b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.780487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.783091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.783730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.784008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.784277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.784945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.786544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.788546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba2ad0-cbee-4679-975e-c478e0d9ea27 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.793332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.796795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.796795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.796795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.796795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.797344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 814/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.797447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.801104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.810726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 782/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.810726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.810726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:31.811079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ffef-a014-4f9c-95a9-dbe9ef4ec370 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.816760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.817364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.817642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.817917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.818552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.820152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.822683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3498ae-9d60-4bc4-aa71-ebd7b942472c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.826344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.831184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.831184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.831184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.834958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 815/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.834958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.838104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.839531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.846100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a6f2f-f4b2-491b-9f1d-b27a3a120f59 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.849964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 783/1598] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:31.859096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.859890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.859890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.859890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.859890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.860271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.860271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.862948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6507a-5abf-4731-89ba-72974fb4230f service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.867818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 816/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.868700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.868870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.869535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.869946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.870148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.870938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.872996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.883256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc20d5-9728-4d04-8e39-68df89143989 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.885706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 784/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.886660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.892259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.894408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.894408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.894408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.894961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.898705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2af67-9b69-47a3-a842-9501a1b23ecb admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.898865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.903869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.905096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.905399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.905669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] PATH_INFO: `/v3/projects/42f9933c573642548af80e4304c1c5fc/users/32c327f6a77444d1adbaae27ee5cefb6/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.910373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 817/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:31.916823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:31.921212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549816-8c7b-44de-8ce3-422536ff574d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:31.925964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f9933c573642548af80e4304c1c5fc, user_id=32c327f6a77444d1adbaae27ee5cefb6, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.927746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:31.928537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:31.929070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:31.929210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:31.929524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] PATH_INFO: `/v3/projects/791397adb8c24e47a16ee8ef0c905373/users/76d057c5f1ca479d87271cc0ed710c12/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:31.932738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:31.945205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=791397adb8c24e47a16ee8ef0c905373, user_id=76d057c5f1ca479d87271cc0ed710c12, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:31.947954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.049003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 785/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:31 2022] PUT /identity/v3/projects/42f9933c573642548af80e4304c1c5fc/users/32c327f6a77444d1adbaae27ee5cefb6/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.050310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.110876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c0db-3f4b-44d5-ba56-ba31d8dc2207 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.115469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.116155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.116400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.116703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] PATH_INFO: `/v3/projects/9d839d32fe76432690489d6173610554/users/e825880a87c0467b8d8dde6bce8ab796/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.132480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d839d32fe76432690489d6173610554, user_id=e825880a87c0467b8d8dde6bce8ab796, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.135261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.136286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 818/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:31 2022] PUT /identity/v3/projects/791397adb8c24e47a16ee8ef0c905373/users/76d057c5f1ca479d87271cc0ed710c12/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.137415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.219185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727170c9-bde0-4d29-82df-a5dadf70d71d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.227883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.229153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.232730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.232730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] PATH_INFO: `/v3/projects/7fd2d999f345491ca55730ebf596403d/users/3666ba6382ae4dcdbd3a6171418f0b98/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.252044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd2d999f345491ca55730ebf596403d, user_id=3666ba6382ae4dcdbd3a6171418f0b98, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.255476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.263211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 786/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:32 2022] PUT /identity/v3/projects/9d839d32fe76432690489d6173610554/users/e825880a87c0467b8d8dde6bce8ab796/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.268186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.339510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa61b95-2a64-4170-b782-68bbaba965ac admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.344666 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.345358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.345636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.345908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] PATH_INFO: `/v3/projects/45e421dfad1d4c92ae0937dd3282ac82/users/60c731fa91114cbebe4754e6e26ab756/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.360230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e421dfad1d4c92ae0937dd3282ac82, user_id=60c731fa91114cbebe4754e6e26ab756, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.362923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965603b-5994-4766-8046-de7d13c4d61c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.368907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 819/1605] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:32 2022] PUT /identity/v3/projects/7fd2d999f345491ca55730ebf596403d/users/3666ba6382ae4dcdbd3a6171418f0b98/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.369715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.419239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:32.437008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390871d-ce46-4006-933b-10d4fb0d4c1a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.443470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.445948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.445948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.445948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] PATH_INFO: `/v3/projects/81483a6316a344a28c9b8184ab252446/users/efec83d35c3c4045ba9fd603c54b1449/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.462642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81483a6316a344a28c9b8184ab252446, user_id=efec83d35c3c4045ba9fd603c54b1449, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.465790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e027a0-b2ca-4818-8d54-873fc8052ef0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.481508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 787/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:32 2022] PUT /identity/v3/projects/45e421dfad1d4c92ae0937dd3282ac82/users/60c731fa91114cbebe4754e6e26ab756/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.484035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764142a4-9f6a-4282-95d2-7ed17bcac626 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.485888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764142a4-9f6a-4282-95d2-7ed17bcac626 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.486497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764142a4-9f6a-4282-95d2-7ed17bcac626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.533982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-764142a4-9f6a-4282-95d2-7ed17bcac626 None None] MFA Rules not processed for user `32c327f6a77444d1adbaae27ee5cefb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.535198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-764142a4-9f6a-4282-95d2-7ed17bcac626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.603584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 820/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:32 2022] PUT /identity/v3/projects/81483a6316a344a28c9b8184ab252446/users/efec83d35c3c4045ba9fd603c54b1449/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:32.608847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3d53-df73-451b-aa50-433d33727e37 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.609258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3d53-df73-451b-aa50-433d33727e37 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.610198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf3d53-df73-451b-aa50-433d33727e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.613668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:32.631556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ebbf3d53-df73-451b-aa50-433d33727e37 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.636562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ebbf3d53-df73-451b-aa50-433d33727e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.636697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 788/1608] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.636697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9498a-5522-4bdc-825f-30e0da5e4d84 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.636697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9498a-5522-4bdc-825f-30e0da5e4d84 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.636697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9498a-5522-4bdc-825f-30e0da5e4d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.664950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-21c9498a-5522-4bdc-825f-30e0da5e4d84 None None] MFA Rules not processed for user `e825880a87c0467b8d8dde6bce8ab796`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.666339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-21c9498a-5522-4bdc-825f-30e0da5e4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.730831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 821/1609] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.732970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.733420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.733998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.746342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 789/1610] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.748701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09b3a-e819-4811-87e0-9310258fc77d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.748701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09b3a-e819-4811-87e0-9310258fc77d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.749266 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09b3a-e819-4811-87e0-9310258fc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.768427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] MFA Rules not processed for user `3666ba6382ae4dcdbd3a6171418f0b98`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.769672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.783067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-33c09b3a-e819-4811-87e0-9310258fc77d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.785136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-33c09b3a-e819-4811-87e0-9310258fc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.796525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 790/1611] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.796525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.796525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.797523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.825944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:32.827296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:32.840618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 791/1612] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.841883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.852523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cc3d2-824f-4d91-ac1e-8f4c012e2166 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.857626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.858321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.858763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.859030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.859884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.862678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.878799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 822/1613] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:32.880526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.940379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533e71-0955-47bf-b614-c3091b10c32a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.944309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:32.944958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.945237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.945509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.955854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:32.958621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a5c8c-ca85-45f2-b524-3f6264ec8659 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:32.969768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 823/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:32.971186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a54f-f28b-42e0-9bda-a35e7c6f146e None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:32.971475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a54f-f28b-42e0-9bda-a35e7c6f146e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:32.971748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7a54f-f28b-42e0-9bda-a35e7c6f146e None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:32.973113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 824/1615] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 5 10:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:32.973884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7a54f-f28b-42e0-9bda-a35e7c6f146e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:32.979857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:32.987727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7a54f-f28b-42e0-9bda-a35e7c6f146e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:32.992790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.000933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.000933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.000933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.002021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 792/1616] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:32 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:33.002981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.005143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.006655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.017004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 825/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:33.017741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.029653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db215c-978e-4f6d-a571-1b8f65c4aebe service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.068422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd5f7a-58d3-4a37-90b6-c495df432523 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.072210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.072859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.073138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.073410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.095584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.096268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.098562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.098562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.098562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.099532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.174383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:33.177136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.178983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d87a1-a5dd-46cc-8cf3-1abf399a7c2f service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.194418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 793/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:33.196414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.196414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.197950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.225519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 826/1619] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:33 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:33.228177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.259909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:33.261255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:33.315885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113fe4-ff98-43a4-9a3e-877bfa4c07d5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.321904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.322723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.323114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.323502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.324399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.326364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.341784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 794/1620] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 5 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:33.343898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.353698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613981-8927-4932-878f-88eb0ee84253 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.358696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.359962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.360232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.360501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.361155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.363088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.464893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 827/1621] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:33 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:33.465873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.466346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 795/1622] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:33 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:33.467860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.504985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f16faf-c1f8-4bee-a210-3381e0e977d0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.507645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.508411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.508842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.509960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.520492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0f22e-9073-4bd1-bfeb-35cdf4e0febf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.535273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.536197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.536197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.539050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.539050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.539050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.556629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 796/1623] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:33.556629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.570506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61b15-29bd-4e38-8600-222c28bc1229 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.577538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.578432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.578715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.579031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.579728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.581359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.596402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 797/1624] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:33.597777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.627746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea3f3-2618-4a61-8cb3-ff6f4a64eab5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.627746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.627746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.627746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.628296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] PATH_INFO: `/v3/projects/12c29e3582f345cd96efcac522e2827e/users/b8960e6a442147288d3a28a917d2875a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.652852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.654813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.665781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c29e3582f345cd96efcac522e2827e, user_id=b8960e6a442147288d3a28a917d2875a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.668473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89cf7e-5474-48a5-bcce-aae6ae935abd admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.669701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 828/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:33.680181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.691756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24387-e603-4146-91cc-3a448a3d1d93 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.696915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.697583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.697859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.698132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] PATH_INFO: `/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc/users/52d30cafb6fc4170b3505621e3d22417/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.716339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f24e8ab025a4d25a13aafa8f1071ffc, user_id=52d30cafb6fc4170b3505621e3d22417, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.719973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.756768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 798/1626] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:33 2022] PUT /identity/v3/projects/12c29e3582f345cd96efcac522e2827e/users/b8960e6a442147288d3a28a917d2875a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:33.769529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed0d-f8a3-4786-9e2c-23387ca6e8c3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.769529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed0d-f8a3-4786-9e2c-23387ca6e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.769529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896ed0d-f8a3-4786-9e2c-23387ca6e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.796366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4896ed0d-f8a3-4786-9e2c-23387ca6e8c3 None None] MFA Rules not processed for user `89cec48cc9904fa09a1921196e678e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:33.799712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4896ed0d-f8a3-4786-9e2c-23387ca6e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:33.822836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 829/1627] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:33 2022] PUT /identity/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc/users/52d30cafb6fc4170b3505621e3d22417/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:33.824245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.981375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43a4f3-f466-4091-b7a6-141aad877e54 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.981375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.981375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.981375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.983353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.983353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.983353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:33.983353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 830/1628] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:33.983353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.983884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 799/1629] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:33.983998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959cc7-55db-4cf2-b256-67f6181f5336 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:33.986027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5fc1-9b6f-4def-b7fc-881c678cb806 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.986314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5fc1-9b6f-4def-b7fc-881c678cb806 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.988195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5fc1-9b6f-4def-b7fc-881c678cb806 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.990768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 800/1630] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 5 10:53:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:33.991161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:33.991674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5fc1-9b6f-4def-b7fc-881c678cb806 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:33.992169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:33.992691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:33.993282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:33.994197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:33.996319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.008115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5fc1-9b6f-4def-b7fc-881c678cb806 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.011778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 831/1631] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:34.012659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.014921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.016576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.017569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.017994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] PATH_INFO: `/v3/projects/12c29e3582f345cd96efcac522e2827e/users/b8960e6a442147288d3a28a917d2875a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.020855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c29e3582f345cd96efcac522e2827e, user_id=b8960e6a442147288d3a28a917d2875a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.024389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddaa0d-0fdc-46e9-8f59-187193d5d171 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.025870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912a0b-1ede-4a56-9d68-dcc4f34bfce8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.033879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.034578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.034908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.035276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.035914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.038272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cba19-1513-4498-9f03-435b1be00541 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.039369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 801/1632] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:33 2022] PUT /identity/v3/projects/12c29e3582f345cd96efcac522e2827e/users/b8960e6a442147288d3a28a917d2875a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:34.041301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.041761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.042180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.075599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:34.077265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:34.161979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 802/1633] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:34.162823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.206917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:34.226923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7366-006e-4e44-bbda-2ed6e24f8f7e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.236808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.237342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.237629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.238081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] PATH_INFO: `/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc/users/52d30cafb6fc4170b3505621e3d22417/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.240470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f24e8ab025a4d25a13aafa8f1071ffc, user_id=52d30cafb6fc4170b3505621e3d22417, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.244508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.254966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 832/1634] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:34 2022] POST /identity/v3/projects => generated 403 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:34.256607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.256897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.257169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.268741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 803/1635] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:34 2022] PUT /identity/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc/users/52d30cafb6fc4170b3505621e3d22417/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:34.268741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.289332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:34.301418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] MFA Rules not processed for user `b8960e6a442147288d3a28a917d2875a`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:34.303157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:34.368576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef791-7f98-4cfa-a11c-bd970afeabfe admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.377379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.378011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.380931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.382431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.414329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 833/1636] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:34.414329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.490011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.491557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53367c-a3ba-429b-aebc-6cf26f3fa903 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.506222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 804/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:34.510911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.511208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.511484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.565147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b922-4e76-42d1-9fb5-1a04745a8865 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.569684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] MFA Rules not processed for user `52d30cafb6fc4170b3505621e3d22417`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:34.571044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:34.571501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.573566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.577389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.577389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.577389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.577389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.688827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 805/1638] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:34.689916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.719021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 834/1639] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:34 2022] POST /identity/v3/users => generated 308 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:34.722641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85672db7-011f-4a4b-9d65-d696f12d2cb9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.723748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:34.739616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.740473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.740819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.741188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.743066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449c9bf-0950-4613-8400-6acb7c46d7a8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:34.757663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:34.758792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:34.759107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:34.759384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:34.760047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.762080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.763025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:34.767333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:34.792624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 835/1640] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:34.794116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:35.109921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 806/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:35.111173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bf239-49fa-4735-9491-754284883d8d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:35.111173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:35.111173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:35.111173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:35.115836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] PATH_INFO: `/v3/projects/d7f349ddc42f469bbcb1112d24951e83/users/38d3a96a241949e7bb5348cbb65d9b2a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:35.121811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:35.122212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f349ddc42f469bbcb1112d24951e83, user_id=38d3a96a241949e7bb5348cbb65d9b2a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:35.122212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:35.122354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ef9b-e46c-47ca-a4ba-16350516e321 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:35.122354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:35.122354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:35.122354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:35.122574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:35.122574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:35.122574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:35.122574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 807/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:35.122769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 836/1643] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:34 2022] PUT /identity/v3/projects/d7f349ddc42f469bbcb1112d24951e83/users/38d3a96a241949e7bb5348cbb65d9b2a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:35.122859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:35.122859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfcc4-47fc-4175-8b13-aa2f08b1c4d1 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:35.157439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:35.158068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:35.158560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:35.158992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:35.159707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:35.161585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:35.176765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 808/1644] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:35.179352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:35.190098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3df539-e94f-4942-8acf-f6d3e41b8121 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:35.195766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:35.196696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:35.197347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:35.197636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] PATH_INFO: `/v3/projects/d7f349ddc42f469bbcb1112d24951e83/users/38d3a96a241949e7bb5348cbb65d9b2a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:35.200391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f349ddc42f469bbcb1112d24951e83, user_id=38d3a96a241949e7bb5348cbb65d9b2a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:35.203482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f02395-802d-4f95-ba08-7268a8919556 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:35.214991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 837/1645] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:35 2022] PUT /identity/v3/projects/d7f349ddc42f469bbcb1112d24951e83/users/38d3a96a241949e7bb5348cbb65d9b2a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:35.332670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:35.430993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204c919-4d53-4f8f-82d2-dddcc528555e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:35.536852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:35.537652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:35.537938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:35.538216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:35.682568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:35.684848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ef658-0ae2-4ede-8e76-5a7d25c53ee2 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:35.699259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 809/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:35.837836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:36.084822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:36.773953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46d03-f800-414c-8c00-d1fc6baccd5a None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:36.774477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46d03-f800-414c-8c00-d1fc6baccd5a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:36.774891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46d03-f800-414c-8c00-d1fc6baccd5a None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:36.776947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 838/1647] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 5 10:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:36.790292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80956d-dff0-4398-bcdf-37cdf0f8f376 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:36.793232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80956d-dff0-4398-bcdf-37cdf0f8f376 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:36.793232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80956d-dff0-4398-bcdf-37cdf0f8f376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:36.820810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7b80956d-dff0-4398-bcdf-37cdf0f8f376 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:36.822033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7b80956d-dff0-4398-bcdf-37cdf0f8f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:36.918652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 810/1648] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 5 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:36.924966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448109-3bfd-4739-a13a-c4521437337f None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:36.925369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448109-3bfd-4739-a13a-c4521437337f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:36.925688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448109-3bfd-4739-a13a-c4521437337f None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:36.927765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 839/1649] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 5 10:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:36.934982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:36.935273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:36.935583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:36.960975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:36.962328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:36.980215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 811/1650] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:37.273074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23448109-3bfd-4739-a13a-c4521437337f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:37.291613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23448109-3bfd-4739-a13a-c4521437337f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:37.296142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:37.297923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:37.298361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:37.298829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:37.312964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:37.315630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:37.345656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 840/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:37.959654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:38.090008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c763-9006-427c-b8dc-2155ee5b5205 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:38.097470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8960e6a442147288d3a28a917d2875a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c29e3582f345cd96efcac522e2827e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:38.098425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:38.098912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:38.099319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:38.100141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:38.100622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:38.102497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:38.128875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 812/1652] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:38.130102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:38.145261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9453-3947-4d5d-a27a-a82f79cf7460 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:38.151761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8960e6a442147288d3a28a917d2875a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c29e3582f345cd96efcac522e2827e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:38.154732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:38.154732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:38.154732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:38.154732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:38.158043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:38.342234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 841/1653] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:38 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:38.343231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:38.359329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c29d4-52ab-4470-ab12-10c26953ec0f tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:38.498884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:38.640241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8960e6a442147288d3a28a917d2875a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c29e3582f345cd96efcac522e2827e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:38.641459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:38.641740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:38.642013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:38.643489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:38.643489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:38.644715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bcbd5-3d38-4ae6-a919-b3f979ec9fa7 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:38.707797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 813/1654] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:53:38.779415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:38.797732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a50-70da-45bb-a6b4-80459ae46de2 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:38.815661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8960e6a442147288d3a28a917d2875a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c29e3582f345cd96efcac522e2827e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:38.817737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:38.818021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:38.823009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] PATH_INFO: `/v3/projects/60d660005ac84d77adaeda0855ce2892` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:38.826148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60d660005ac84d77adaeda0855ce2892)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:38.829161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:39.107502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d660005ac84d77adaeda0855ce2892', 'request_id': 'req-74130539-3b6a-49d1-b4ab-b33140041d93'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:39.129268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d660005ac84d77adaeda0855ce2892', 'request_id': 'req-74130539-3b6a-49d1-b4ab-b33140041d93'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:39.284232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d660005ac84d77adaeda0855ce2892', 'request_id': 'req-74130539-3b6a-49d1-b4ab-b33140041d93'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:39.315853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] The token cache is being invalidate because project 60d660005ac84d77adaeda0855ce2892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:39.316429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:39.321135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:39.327373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 842/1655] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:38 2022] DELETE /identity/v3/projects/60d660005ac84d77adaeda0855ce2892 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:39.615459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:39.802843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:39.803104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:39.803378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:39.892148 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] MFA Rules not processed for user `38d3a96a241949e7bb5348cbb65d9b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:39.893601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:40.024294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 814/1656] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:40.687873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:40.694385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:40.762687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:40.764203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:40.770084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:40.841404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:40.927446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74130539-3b6a-49d1-b4ab-b33140041d93 tempest-VolumeQuotaClassesTest-267524620 tempest-VolumeQuotaClassesTest-267524620-project-admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:40.939497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:40.940820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:40.942508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:40.942937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] PATH_INFO: `/v3/users/32c327f6a77444d1adbaae27ee5cefb6` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:40.947349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c327f6a77444d1adbaae27ee5cefb6)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:40.951980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: WARNING py.warnings [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:40.951980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: warnings.warn(msg) Sep 05 10:53:40.951980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: Sep 05 10:53:40.955353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:41.067559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057928-ef32-41c4-992e-6355cfd92697 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:41.079862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:41.080867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:41.083994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:41.087203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] PATH_INFO: `/v3/users/e825880a87c0467b8d8dde6bce8ab796` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:41.087203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e825880a87c0467b8d8dde6bce8ab796)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:41.092235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:41.409376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c327f6a77444d1adbaae27ee5cefb6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.409920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e825880a87c0467b8d8dde6bce8ab796'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.410365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c327f6a77444d1adbaae27ee5cefb6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.412995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e825880a87c0467b8d8dde6bce8ab796'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.431013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e825880a87c0467b8d8dde6bce8ab796'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.433174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e825880a87c0467b8d8dde6bce8ab796'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.440269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c327f6a77444d1adbaae27ee5cefb6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.470302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c2540f68-6475-4302-9c48-0e9cab209c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e825880a87c0467b8d8dde6bce8ab796'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.492922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c327f6a77444d1adbaae27ee5cefb6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.493996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d5849bea-92ad-461d-8d94-f84a153b530c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c327f6a77444d1adbaae27ee5cefb6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:41.577168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 815/1657] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:40 2022] DELETE /identity/v3/users/e825880a87c0467b8d8dde6bce8ab796 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:41.582622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:41.583309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:41.583683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:41.649479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 843/1658] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:40 2022] DELETE /identity/v3/users/32c327f6a77444d1adbaae27ee5cefb6 => generated 0 bytes in 963 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:41.653473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:41.654363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:41.654884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:41.655351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:41.659790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:41.760849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:41.768496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:41.882412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 844/1659] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:41.936030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:41.938303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:41.938557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 816/1660] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:41.973381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:41.975174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:42.076287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7cf70-97b1-4973-ae49-09a96eab8847 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:42.083255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:42.101052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:42.106330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:42.106969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:42.108256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:42.115377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35047d-d0b1-4e36-ad85-cfc0e28b7f88 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:42.123206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:42.124091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:42.138796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:42.138796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:42.139206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:42.139206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b10c4-e313-4cd1-ab6b-f037f730672b service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:42.151796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:42.153718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a758d20-1881-45ca-8a07-742209437d78 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:42.157728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 845/1661] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:42.176899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 817/1662] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:53:42.937674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:42.938484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:42.939600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:42.944214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 846/1663] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:53:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:43.001758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:43.002603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:43.002905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:43.040989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:43.040989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:43.202057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 818/1664] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:43.247957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:43.256405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:43.298523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8689fa-8e27-43f0-9645-8a6aa7b369c7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:43.305863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:43.307680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:43.308670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:43.309125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:43.324903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:43.329100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:43.368143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 847/1665] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:43.519843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:43.991739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:43.993241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:44.010126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a974-ceb9-458c-aa16-2e89e794d857 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:44.015553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:44.016223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:44.016500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:44.017038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] PATH_INFO: `/v3/users/3666ba6382ae4dcdbd3a6171418f0b98` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:44.018384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3666ba6382ae4dcdbd3a6171418f0b98)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:44.020487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:44.158677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:44.160689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:44.189970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb554cbf-858d-43f3-a8a1-f24e7c84ddce service placement] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:44.196547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:44.197850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:44.198292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:44.198713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] PATH_INFO: `/v3/projects/42f9933c573642548af80e4304c1c5fc` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:44.200029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f9933c573642548af80e4304c1c5fc)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:44.202130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:44.302500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3666ba6382ae4dcdbd3a6171418f0b98'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.309967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3666ba6382ae4dcdbd3a6171418f0b98'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.364083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3666ba6382ae4dcdbd3a6171418f0b98'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.365065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3666ba6382ae4dcdbd3a6171418f0b98'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.369256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f9933c573642548af80e4304c1c5fc', 'request_id': 'req-1684c419-51d9-472e-83d1-9767ba7ad0cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.381751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f9933c573642548af80e4304c1c5fc', 'request_id': 'req-1684c419-51d9-472e-83d1-9767ba7ad0cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.416402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3666ba6382ae4dcdbd3a6171418f0b98'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.533807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f9933c573642548af80e4304c1c5fc', 'request_id': 'req-1684c419-51d9-472e-83d1-9767ba7ad0cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.548055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] The token cache is being invalidate because project 42f9933c573642548af80e4304c1c5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:44.550287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.551293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:44.554303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 848/1666] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:44 2022] DELETE /identity/v3/projects/42f9933c573642548af80e4304c1c5fc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:53:44.558914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:44.578292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:44.690452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 819/1667] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:43 2022] DELETE /identity/v3/users/3666ba6382ae4dcdbd3a6171418f0b98 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:44.691684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:44.696022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:44.757925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c419-51d9-472e-83d1-9767ba7ad0cd admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:44.899594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46632e48-d5d5-42f9-9795-61d68bd3f1a3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:44.910034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:44.910808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:44.911020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:44.911293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] PATH_INFO: `/v3/users/b8960e6a442147288d3a28a917d2875a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:44.912446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:44.913552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:44.913975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:44.914128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8960e6a442147288d3a28a917d2875a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:44.914439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] PATH_INFO: `/v3/projects/9d839d32fe76432690489d6173610554` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:44.915789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d839d32fe76432690489d6173610554)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:44.916373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:44.917372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: WARNING py.warnings [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:53:44.917372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: warnings.warn(msg) Sep 05 10:53:44.917372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: Sep 05 10:53:44.918897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:44.963509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:45.102529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d839d32fe76432690489d6173610554', 'request_id': 'req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.122419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d839d32fe76432690489d6173610554', 'request_id': 'req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.196448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8960e6a442147288d3a28a917d2875a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.200823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8960e6a442147288d3a28a917d2875a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.213298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8960e6a442147288d3a28a917d2875a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.219871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d839d32fe76432690489d6173610554', 'request_id': 'req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.241049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8960e6a442147288d3a28a917d2875a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.244941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-de9b734f-3696-4009-9ebc-b6b3e92d1fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8960e6a442147288d3a28a917d2875a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.259970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] The token cache is being invalidate because project 9d839d32fe76432690489d6173610554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:45.260348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.263202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5a679ff2-dc24-4fb3-bbe0-d8a99dfa2149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:45.264901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 820/1668] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:44 2022] DELETE /identity/v3/projects/9d839d32fe76432690489d6173610554 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:45.268155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.271053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.272110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.322327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:45.323752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:45.377871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 849/1669] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:44 2022] DELETE /identity/v3/users/b8960e6a442147288d3a28a917d2875a => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:53:45.379535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a958d-7e2c-4a00-bb57-4a644ea4907a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.380036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a958d-7e2c-4a00-bb57-4a644ea4907a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.380481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a958d-7e2c-4a00-bb57-4a644ea4907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.441328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-323a958d-7e2c-4a00-bb57-4a644ea4907a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:45.441328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-323a958d-7e2c-4a00-bb57-4a644ea4907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:45.465550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 821/1670] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:45.498899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:45.500523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:45.590924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 850/1671] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:45.603322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.603322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.608187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.769155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:45.776831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:45.781254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:45.811691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd90b8-48f0-49e6-99e2-75a57388afa5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:45.839243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 851/1672] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:45.841367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:45.864284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4ccd-c06c-4fd7-837e-503c12e495fa None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:45.896300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:45.897331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.897757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.898171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.899002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:45.899458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:45.901508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:45.911111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:45.911750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.912034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.912307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.927149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:45.930744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:45.944697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 822/1673] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:53:45.960295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:45.968615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 852/1674] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:45.974857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f388558-52e9-44e1-a385-0bc9c0bba3fd service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:45.981970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:45.982813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:45.983101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:45.983513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:45.985530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:45.988325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.131796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 823/1675] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:45 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:46.133117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:46.147379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3f02-e86e-4345-b5c1-bdb77a067440 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:46.241554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:46.242151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.242531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.242680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.243445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:46.246738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.280051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:46.283729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:46.309281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5303ec-ccdf-47b1-81a7-a49805dfc6a8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:46.317406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:46.318186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.318467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.318746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] PATH_INFO: `/v3/users/89cec48cc9904fa09a1921196e678e8f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.325527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cec48cc9904fa09a1921196e678e8f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:46.329528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.380795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 853/1676] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:46 2022] POST /identity/v3/users => generated 282 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:46.384396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:46.400233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a3cbf-f34d-4eb7-a36e-f77d2759a22a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:46.407095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:46.413476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.414168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.414587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.415509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:46.417382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.455300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 854/1677] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:53:46.459514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:46.476164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466c9d-1f2e-43c6-bea7-45ecf9a723ae admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:46.485233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:46.486111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.486540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.487278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.488149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:46.492208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.509011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 855/1678] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:46.513494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:46.544571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf58cb-776e-4e91-a5c6-2fa1f00ac51e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:46.557814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:46.559110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.559539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.559955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] PATH_INFO: `/v3/projects/ea7edaed1382420ba9d10d0eb032a14a/users/70c6e2e436dd479d92c748f370b6a4c0/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.582342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:46.586835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cec48cc9904fa09a1921196e678e8f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:46.588215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cec48cc9904fa09a1921196e678e8f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:46.611836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cec48cc9904fa09a1921196e678e8f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:46.615431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cec48cc9904fa09a1921196e678e8f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:46.621768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7edaed1382420ba9d10d0eb032a14a, user_id=70c6e2e436dd479d92c748f370b6a4c0, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:46.646269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1287e360-5f5e-4606-8cee-6feecda27647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cec48cc9904fa09a1921196e678e8f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:46.657582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f49da5-7a63-458e-8a0a-31341ef101f1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:46.778308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 824/1679] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:46 2022] DELETE /identity/v3/users/89cec48cc9904fa09a1921196e678e8f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:46.815113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 856/1680] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:46 2022] PUT /identity/v3/projects/ea7edaed1382420ba9d10d0eb032a14a/users/70c6e2e436dd479d92c748f370b6a4c0/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:46.815788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.815788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.815788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.818915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:46.819585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:46.819585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:46.861893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] MFA Rules not processed for user `aa80a09a986646ab98a5cfdac813bd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:46.866088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:46.886042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] MFA Rules not processed for user `70c6e2e436dd479d92c748f370b6a4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:46.887463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:47.035067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 825/1681] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:47.051751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:47.053394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:47.072985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 857/1682] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:53:47.077072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:47.084626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:47.238940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b734-93c6-4121-8fee-5908fbe45d40 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:47.252463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:47.254225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:47.257199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:47.257718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:47.258700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:47.264392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:47.266847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b7b20-1f12-43e7-8b11-6c47e7624503 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:47.284818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:47.284818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:47.284818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:47.284818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:47.308159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:47.310153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:47.340034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 826/1683] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:53:47.417403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 858/1684] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:47 2022] POST /identity/v3/projects => generated 365 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:47.421646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:47.439922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:47.445999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:47.448264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:47.452018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa294-be52-4f0c-ad99-e0e6aa6bf6a3 service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:47.668386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec208-7714-447a-acb2-becde1d96e80 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:47.673534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:47.674173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:47.675616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:47.675895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:47.676543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:47.679928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:47.682778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:47.683637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:47.683921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:47.684190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] PATH_INFO: `/v3/projects/7fd2d999f345491ca55730ebf596403d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:47.685589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd2d999f345491ca55730ebf596403d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:47.692915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:47.831917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 827/1685] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:47 2022] POST /identity/v3/users => generated 289 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:47.836823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:47.881311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742ecc9-fd49-49a9-bbca-af8babbe45bf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:47.911573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd2d999f345491ca55730ebf596403d', 'request_id': 'req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:47.935038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd2d999f345491ca55730ebf596403d', 'request_id': 'req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.078503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:48.079138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:48.079416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:48.085949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:48.085949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:48.085949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:48.089826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd2d999f345491ca55730ebf596403d', 'request_id': 'req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.113942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] The token cache is being invalidate because project 7fd2d999f345491ca55730ebf596403d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:48.114405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.115263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.117579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 859/1686] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:47 2022] DELETE /identity/v3/projects/7fd2d999f345491ca55730ebf596403d => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:48.118621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:48.120235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:48.125634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 828/1687] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:48.134877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:48.139927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:48.143409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6b27c-efa6-4d00-ab26-8b03fd4f1b70 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:48.144828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:48.154064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:48.165285 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:48.165598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:48.165886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] PATH_INFO: `/v3/projects/755d795adee340bebf8742d6e0c3bf53` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:48.169093 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755d795adee340bebf8742d6e0c3bf53)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:48.173430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:48.178903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbb672-d717-4568-bc76-358e3d7ef090 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:48.208518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:48.209201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:48.209478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:48.209749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] PATH_INFO: `/v3/users/52d30cafb6fc4170b3505621e3d22417` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:48.217570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d30cafb6fc4170b3505621e3d22417)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:48.220816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:48.385194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755d795adee340bebf8742d6e0c3bf53', 'request_id': 'req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.397149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755d795adee340bebf8742d6e0c3bf53', 'request_id': 'req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.532551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755d795adee340bebf8742d6e0c3bf53', 'request_id': 'req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.555485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] The token cache is being invalidate because project 755d795adee340bebf8742d6e0c3bf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:48.555833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.556476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.558475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 860/1688] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:48 2022] DELETE /identity/v3/projects/755d795adee340bebf8742d6e0c3bf53 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:48.559202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:48.560627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:48.577035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d30cafb6fc4170b3505621e3d22417'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.583140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d30cafb6fc4170b3505621e3d22417'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.613926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d30cafb6fc4170b3505621e3d22417'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.614847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d30cafb6fc4170b3505621e3d22417'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.661861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d30cafb6fc4170b3505621e3d22417'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:48.702139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0b4c-68dc-4ca8-a9de-b5be3405f212 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:48.713332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:48.714331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:48.714763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:48.715212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] PATH_INFO: `/v3/projects/f025ad097ace4af4adfd90eee04bcc11/users/a1f0629195a4441fb188d8a257bcd759/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:48.750605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f025ad097ace4af4adfd90eee04bcc11, user_id=a1f0629195a4441fb188d8a257bcd759, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:48.756400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:48.769695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 829/1689] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:48 2022] DELETE /identity/v3/users/52d30cafb6fc4170b3505621e3d22417 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:48.771025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:48.773051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:48.853291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 861/1690] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:48 2022] PUT /identity/v3/projects/f025ad097ace4af4adfd90eee04bcc11/users/a1f0629195a4441fb188d8a257bcd759/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:48.854278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:48.859219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:48.930009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b401348-aa91-4109-a4fd-17d6e4bf77e3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:49.062972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2987f-73d0-45bf-b9c9-6844953565c3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:49.075548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:49.076265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.076470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.076774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] PATH_INFO: `/v3/users/38d3a96a241949e7bb5348cbb65d9b2a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.078423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d3a96a241949e7bb5348cbb65d9b2a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:49.082443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:49.105249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:49.105960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.106244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.106535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] PATH_INFO: `/v3/projects/12c29e3582f345cd96efcac522e2827e` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.107832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c29e3582f345cd96efcac522e2827e)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:49.110603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:49.254146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:49.329366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c29e3582f345cd96efcac522e2827e', 'request_id': 'req-6e67d713-0b53-4f34-9513-329776a7edff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.343647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c29e3582f345cd96efcac522e2827e', 'request_id': 'req-6e67d713-0b53-4f34-9513-329776a7edff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.434903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d3a96a241949e7bb5348cbb65d9b2a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.437594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d3a96a241949e7bb5348cbb65d9b2a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.437941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c29e3582f345cd96efcac522e2827e', 'request_id': 'req-6e67d713-0b53-4f34-9513-329776a7edff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.454013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] The token cache is being invalidate because project 12c29e3582f345cd96efcac522e2827e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:49.454377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.456576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.465495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 830/1691] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:48 2022] DELETE /identity/v3/projects/12c29e3582f345cd96efcac522e2827e => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:49.466436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:49.473109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d3a96a241949e7bb5348cbb65d9b2a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.473480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.512183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d3a96a241949e7bb5348cbb65d9b2a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.518241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0a918e4a-9852-4d40-aaf5-c705158da05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d3a96a241949e7bb5348cbb65d9b2a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:49.602897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d713-0b53-4f34-9513-329776a7edff admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:49.608223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:49.609708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.610053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.610392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.611160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:49.614877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547294d5-33e5-4452-93b6-53f076735c0b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:49.638566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 831/1692] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:49.638566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.638566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.638566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.646457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 862/1693] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:48 2022] DELETE /identity/v3/users/38d3a96a241949e7bb5348cbb65d9b2a => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:49.648352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72e41-ab31-42d2-875c-2f821024f14c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.649677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72e41-ab31-42d2-875c-2f821024f14c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.650700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72e41-ab31-42d2-875c-2f821024f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.677780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:49.682463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.729213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1bc72e41-ab31-42d2-875c-2f821024f14c None None] MFA Rules not processed for user `60c731fa91114cbebe4754e6e26ab756`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:49.730915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1bc72e41-ab31-42d2-875c-2f821024f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.856495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 832/1694] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:49.856987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:49.862151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.905745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 863/1695] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:49.905745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.905745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.905745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.917863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc473-db69-4e06-81a9-71d0b745ba80 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:49.923293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:49.940404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:49.941140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:49.941734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:49.942243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] PATH_INFO: `/v3/projects/f025ad097ace4af4adfd90eee04bcc11/users/a1f0629195a4441fb188d8a257bcd759/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:49.951685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:49.953259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.961425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f025ad097ace4af4adfd90eee04bcc11, user_id=a1f0629195a4441fb188d8a257bcd759, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:49.967345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:49.979267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 864/1696] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:49.984815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:49.990898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:49.992298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 833/1697] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:49 2022] PUT /identity/v3/projects/f025ad097ace4af4adfd90eee04bcc11/users/a1f0629195a4441fb188d8a257bcd759/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:49.993761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:50.184196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea6b4-e97e-4c05-81cd-e21000ae08a1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:50.193443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ea72-717a-4d92-96d1-d6b48b6d4c49 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:50.206601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:50.207543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.208294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.209822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:50.213272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:50.213773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:50.215650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c5549-79c0-49fa-8ad1-066178d799fb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:50.248108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 834/1698] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:50.266351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.268085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.268583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:50.345489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:50.346625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.347099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.347623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:50.370610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:50.376978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] MFA Rules not processed for user `a1f0629195a4441fb188d8a257bcd759`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:50.382007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:50.484476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:50.486782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:50.517612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 865/1699] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:50.517612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:50.553976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43df75-bbd0-4ecd-84b0-07ff76fa1da7 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:50.568115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:50.572041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.572348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.574323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:50.578036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:50.595180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:50.705104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 835/1700] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:50.728865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:50.728865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:50.742678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 866/1701] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:50 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:50.743836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:50.751124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:50.779123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d50e42-dd77-4199-b5ce-203c70ce33cf None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:50.978641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:50.979394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.979676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.980520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d6e82-5330-4043-ac0f-f8968d82d0ff admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:50.981093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] PATH_INFO: `/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:50.983111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f24e8ab025a4d25a13aafa8f1071ffc)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:50.985713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:50.987982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:50.989278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:50.990061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:50.990343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.122132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:51.124062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7a6b-826f-4238-a01c-f5aecb2e2dd1 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:51.153251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 867/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:51.155150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.156288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.157060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.219693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f24e8ab025a4d25a13aafa8f1071ffc', 'request_id': 'req-0169f876-cedf-4923-be71-d61780f9692b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:51.222281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] MFA Rules not processed for user `76d057c5f1ca479d87271cc0ed710c12`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:51.224304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.248579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f24e8ab025a4d25a13aafa8f1071ffc', 'request_id': 'req-0169f876-cedf-4923-be71-d61780f9692b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:51.412662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 868/1703] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:51.422511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:51.443117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f24e8ab025a4d25a13aafa8f1071ffc', 'request_id': 'req-0169f876-cedf-4923-be71-d61780f9692b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:51.461490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] The token cache is being invalidate because project 1f24e8ab025a4d25a13aafa8f1071ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:51.461695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:51.464073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0169f876-cedf-4923-be71-d61780f9692b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:51.471324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 836/1704] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:50 2022] DELETE /identity/v3/projects/1f24e8ab025a4d25a13aafa8f1071ffc => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:51.472731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbe0f8-3a19-4507-837b-38fe0092bc41 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.473017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbe0f8-3a19-4507-837b-38fe0092bc41 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.475980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbe0f8-3a19-4507-837b-38fe0092bc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.539924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60da51-6fea-49fc-98a6-982b491865d2 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:51.572238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:51.572238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.572238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.572238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.572703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:51.584209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:51.589902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-05dbe0f8-3a19-4507-837b-38fe0092bc41 None None] MFA Rules not processed for user `efec83d35c3c4045ba9fd603c54b1449`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:51.591248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-05dbe0f8-3a19-4507-837b-38fe0092bc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.730673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 869/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:51 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:51.731700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:51.747989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.779105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cdb1e-bae3-48e7-9768-57b86eb457f0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:51.780400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 837/1706] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:51.785073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b3f0-06b0-46cb-9bed-0ae21230fb04 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.785468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b3f0-06b0-46cb-9bed-0ae21230fb04 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.785840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b3f0-06b0-46cb-9bed-0ae21230fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.825432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f796b3f0-06b0-46cb-9bed-0ae21230fb04 None None] MFA Rules not processed for user `76d057c5f1ca479d87271cc0ed710c12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:51.826776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f796b3f0-06b0-46cb-9bed-0ae21230fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.841870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:51.846758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 838/1707] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:51.846956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.846956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.847178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.847178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.847178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.847416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] PATH_INFO: `/v3/projects/d7f349ddc42f469bbcb1112d24951e83` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.856003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f349ddc42f469bbcb1112d24951e83)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:51.868016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:51.892901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:51.896537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.918875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 839/1708] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:51.920573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:51.928583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:51.968789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760193ca-f539-41b9-ac5c-5699ac8adc90 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:51.977027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:51.977429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:51.977806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:51.978160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:51.978933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:51.980609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3b432-2fe9-4bc9-963e-6bb6b7789adc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.003093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 840/1709] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:52.007287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.007681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.009537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.044925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] MFA Rules not processed for user `efec83d35c3c4045ba9fd603c54b1449`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:52.048796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.071102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 841/1710] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:52.072053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.077543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.122124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f349ddc42f469bbcb1112d24951e83', 'request_id': 'req-a785c829-3c01-4873-aecf-cb3b73e28a73'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:52.135072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f349ddc42f469bbcb1112d24951e83', 'request_id': 'req-a785c829-3c01-4873-aecf-cb3b73e28a73'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:52.220372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:52.221799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb07c70-2544-48bd-845d-5be5b4106fd1 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.231006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f349ddc42f469bbcb1112d24951e83', 'request_id': 'req-a785c829-3c01-4873-aecf-cb3b73e28a73'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:52.246757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] The token cache is being invalidate because project d7f349ddc42f469bbcb1112d24951e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:52.247381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:52.250905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a785c829-3c01-4873-aecf-cb3b73e28a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:52.250905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 870/1711] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:51 2022] DELETE /identity/v3/projects/d7f349ddc42f469bbcb1112d24951e83 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:52.252079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.252460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.252872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.314665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:52.317965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.418426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.418983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.422163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.422455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.425190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.430333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 871/1712] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:52.431572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.433980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.453784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ac78d-2b9d-4ec6-a75b-4e76dc45b5f3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.460017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.460838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.462420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.462420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.463376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.466102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.484191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 872/1713] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:52.485681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.487548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.527784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62509-72f7-418b-b2ed-c38dca97a12b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.533643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:52.543065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.544383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.547291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.547774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.553483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.667860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.667860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a3f23-4e02-4d08-b45b-835cffb52436 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.682554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 842/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:52.683885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.684552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.684552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.703108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.706834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.714511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:52.714511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.721701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 843/1715] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:52.722734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.724725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 873/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:52.725770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.734921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c58c2f-96b6-4352-ba00-15c5b2bc5563 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.740093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.740890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.741165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.741275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d8587-205f-435a-9b22-38b4ed2f12d5 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.741433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.742090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:52.742527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.744918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0571be-ec7d-4186-902c-12831c165c08 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.750020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.751152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.751663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.752117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] PATH_INFO: `/v3/projects/22dc72a8dbeb45df8e9a9311f3dee17e/users/893c537460704361928fa5c3089a3906/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.764457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 844/1717] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:52.764457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649932f7-7974-47bd-8187-273ed042d738 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.764457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649932f7-7974-47bd-8187-273ed042d738 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.764457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649932f7-7974-47bd-8187-273ed042d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.777936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22dc72a8dbeb45df8e9a9311f3dee17e, user_id=893c537460704361928fa5c3089a3906, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.781738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.787698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-649932f7-7974-47bd-8187-273ed042d738 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:52.789158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-649932f7-7974-47bd-8187-273ed042d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:52.798931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 845/1718] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:52.799744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649932f7-7974-47bd-8187-273ed042d738 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:52.830070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649932f7-7974-47bd-8187-273ed042d738 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:52.835845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:52.836444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:52.836754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:52.837655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:52.838362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:52.840895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980731-81cd-4eb0-9fc0-c4606109ab50 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:52.983290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 874/1719] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:52 2022] PUT /identity/v3/projects/22dc72a8dbeb45df8e9a9311f3dee17e/users/893c537460704361928fa5c3089a3906/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:52.985506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.028625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 846/1720] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:52 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:53.028625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361be-309e-4111-be6c-735e54ce461a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:53.028889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361be-309e-4111-be6c-735e54ce461a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:53.029138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815361be-309e-4111-be6c-735e54ce461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:53.103264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-815361be-309e-4111-be6c-735e54ce461a None None] MFA Rules not processed for user `893c537460704361928fa5c3089a3906`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:53.105038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-815361be-309e-4111-be6c-735e54ce461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:53.136273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fde5-7e22-488d-a0f1-870427519e87 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:53.224636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 847/1721] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:53.232934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815361be-309e-4111-be6c-735e54ce461a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.256830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:53.257464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:53.257742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:53.259480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:53.260153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:53:53.260459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:53.265913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:53.285497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 875/1722] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:53:53.285497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.290792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:53.324050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e406102-5be4-43d2-b5de-7d202799ae84 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:53.342596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:53.345583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:53.346172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:53.346292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] PATH_INFO: `/v3/users/70c6e2e436dd479d92c748f370b6a4c0` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:53.350596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c6e2e436dd479d92c748f370b6a4c0)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:53.356897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:53.371478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815361be-309e-4111-be6c-735e54ce461a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:53.386894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:53.387561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:53.387804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:53.388610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:53.389111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:53.393681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:53.586443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 848/1723] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:53 2022] POST /identity/v3/users => generated 305 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:53.594467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.610181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5cf46-61bf-443d-8dd2-8ead92319762 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:53.617946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:53.618570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:53.618846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:53.619116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:53.619767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:53.622242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:53.704663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c6e2e436dd479d92c748f370b6a4c0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:53.706091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c6e2e436dd479d92c748f370b6a4c0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:53.720198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c6e2e436dd479d92c748f370b6a4c0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:53.757774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c6e2e436dd479d92c748f370b6a4c0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:53.765804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c6e2e436dd479d92c748f370b6a4c0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:53.804206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 849/1724] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:53 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:53.804206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.806892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:53.889042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 876/1725] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:53 2022] DELETE /identity/v3/users/70c6e2e436dd479d92c748f370b6a4c0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:53.891079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:53.894085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:53.976906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bad68-e3ed-4e63-9f76-f593b0780d58 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.112719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:54.124884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505c604-5fc7-42d8-a124-d3862e88d747 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.135402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.136040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.136318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.136609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.137295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.142261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d105f0d-7098-4b38-98fa-7a0ae96015a7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.166500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.167129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.167406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.167681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.168473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.170473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa24ed-99cd-45d7-a4bf-4d686504d992 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.184648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 877/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:54.186182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.187190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.187443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.188863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 878/1727] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 5 10:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:54.194226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.200412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.259404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babce8-64b4-4d27-a811-9fcb4b0d2e13 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.277410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.278435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.278924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.279467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.280627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.282985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.364360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 850/1728] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:53 2022] POST /identity/v3/projects => generated 371 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:54.365935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2202b-083d-40bf-91e6-a7d64b4943ed None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.366741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2202b-083d-40bf-91e6-a7d64b4943ed None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.369375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2202b-083d-40bf-91e6-a7d64b4943ed None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.371145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 851/1729] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 5 10:53:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:54.374044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.376006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.376986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.393606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 879/1730] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:54 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:54.396466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.421803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f64-e948-4da3-b9ad-09842bc79fbe admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.462221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:54.463619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.528211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:54.552343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.553002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.553283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.553574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.554208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.555873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f0f95-0240-4006-a032-b4923fb4d0da admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.571148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 880/1731] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:54.571148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ebc-1552-4bc3-9802-533c3b143cb5 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.571148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ebc-1552-4bc3-9802-533c3b143cb5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.571148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ebc-1552-4bc3-9802-533c3b143cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.582702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 852/1732] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:54.582702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.591298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ec7e9-59b8-4b30-a8bd-99ca7535368f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.597179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.598209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.598492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.598765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.599411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.601415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.649055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b2e69ebc-1552-4bc3-9802-533c3b143cb5 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:54.650357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b2e69ebc-1552-4bc3-9802-533c3b143cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.714911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 881/1733] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:54.729627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 853/1734] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:54 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:54.730963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.739451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.740302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.740630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.756293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ea65-ce66-44e4-ad57-4cbb5bedcb6f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.770281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.770915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.771242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.772028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.772381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.774090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.778650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:54.779905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.789611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 882/1735] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:54.790915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.808781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 854/1736] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:54.812258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd093105-4fc6-4519-8016-2b110ac54928 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.812744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.816650 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.827710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.828408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.829062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.829345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] PATH_INFO: `/v3/projects/4a50f0f47b5a4908975faea94d8a93c8/users/af471e72bf474b28ad5dd3c7dc19d860/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.844601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f026-48c4-486b-bef2-745c715af06d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.849343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.849973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.850253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.850526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.858795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a50f0f47b5a4908975faea94d8a93c8, user_id=af471e72bf474b28ad5dd3c7dc19d860, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.862082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.863246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.865735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.881126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 855/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:54.886082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.897571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023bbfe-eded-4378-bfee-375b5d9402c0 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.903060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.904761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.904761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.904761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.905355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.907681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.918842 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 856/1738] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:54.919848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.922404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:54.935664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc3e13-65fd-449e-a648-519c9fa2f4a5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.941195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:54.941947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:54.943072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:54.943072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:54.951207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:54.954814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:54.963976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 857/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:54.973252 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:54.987807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 883/1740] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:54 2022] PUT /identity/v3/projects/4a50f0f47b5a4908975faea94d8a93c8/users/af471e72bf474b28ad5dd3c7dc19d860/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:54.996370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42269e-ec43-4652-82eb-c8be09c09383 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:54.998487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.145085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.146957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.147240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.147511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.159857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.161687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.163751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef597-5c97-43dd-b21f-93696c948883 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.181408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.182125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.182396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.182728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] PATH_INFO: `/v3/projects/b0be07d5701248e783850e344dcdf42e/users/57ed1d6da1454701a0b132f0b72f3fbe/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.186396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 858/1741] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:55.189365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.214007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0be07d5701248e783850e344dcdf42e, user_id=57ed1d6da1454701a0b132f0b72f3fbe, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.217394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ab8ff-0123-42ed-a0fb-e195fd4e5abd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.220536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e47cc1-b896-49c2-8a58-edff0632fb1f service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.233500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.236739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.236739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.236739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.236739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.240944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5196d-e33c-44bf-81a6-4c1cbcd2b308 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.268493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 859/1742] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:55.270024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.270420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.270823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.294546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:55.302354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] MFA Rules not processed for user `aa80a09a986646ab98a5cfdac813bd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:55.303744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:55.339056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 884/1743] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:54 2022] PUT /identity/v3/projects/b0be07d5701248e783850e344dcdf42e/users/57ed1d6da1454701a0b132f0b72f3fbe/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:55.340618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.341011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.341402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.403193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 860/1744] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:55.404041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.428243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748d46b-061a-4b59-a023-5696e4c86065 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.435556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] MFA Rules not processed for user `af471e72bf474b28ad5dd3c7dc19d860`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:55.437553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:55.575931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.576677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.576957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.577472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] PATH_INFO: `/v3/projects/c51f6a9117e94664afe932683c6c0440/users/e640198750cc4803b8d60969076fa313/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.630310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51f6a9117e94664afe932683c6c0440, user_id=e640198750cc4803b8d60969076fa313, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.634956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.641052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 885/1745] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:55.642018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.659563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c4938-60bb-4019-93ce-980b20595180 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.665569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.666189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.666464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.666737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.667423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.669199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c60cd-77d0-475d-a3d4-92176e0857e1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.691081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 886/1746] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:55.692607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.694860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.695677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.730806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] MFA Rules not processed for user `60c731fa91114cbebe4754e6e26ab756`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:55.732211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:55.755976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 861/1747] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:55 2022] PUT /identity/v3/projects/c51f6a9117e94664afe932683c6c0440/users/e640198750cc4803b8d60969076fa313/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:55.756862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.852354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 887/1748] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:55.853426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:55.872043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1bcb-079b-4994-aaa2-6066652a8952 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.881207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.882333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.882617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.882895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.884443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.888481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef802-5e21-4ded-a43f-33aba451d99f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.963814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6667f2-bc3b-4366-b686-7e7609001bb2 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:55.970244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:55.973656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:55.974010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:55.974298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] PATH_INFO: `/v3/projects/b0be07d5701248e783850e344dcdf42e/users/57ed1d6da1454701a0b132f0b72f3fbe/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:55.978523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0be07d5701248e783850e344dcdf42e, user_id=57ed1d6da1454701a0b132f0b72f3fbe, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:55.981522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:55.994386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 888/1749] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:55 2022] PUT /identity/v3/projects/b0be07d5701248e783850e344dcdf42e/users/57ed1d6da1454701a0b132f0b72f3fbe/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:55.995380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.004944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.015025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 862/1750] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:55 2022] POST /identity/v3/projects => generated 409 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:56.016247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.016534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.016849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.111240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc70c-29e7-498e-acbc-c419ab097f95 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.119840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] MFA Rules not processed for user `e640198750cc4803b8d60969076fa313`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:56.119840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.245299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:56.248871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.253423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 863/1751] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:56.254899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.255252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.255413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] PATH_INFO: `/v3/projects/ea7edaed1382420ba9d10d0eb032a14a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.257693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7edaed1382420ba9d10d0eb032a14a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:56.258972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.260012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:56.260401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.351657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61fe6-01a8-4fdc-a3e1-147e492dfff9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.357746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.358477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.358874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.359267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.361063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.373751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:56.376907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b646a2a-03fc-482d-be9c-b98fa2574ce0 service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:56.388376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 864/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:56.390156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3a5d-22d0-4ebc-9f31-fe62ad1ce21b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.390617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3a5d-22d0-4ebc-9f31-fe62ad1ce21b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.392515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc3a5d-22d0-4ebc-9f31-fe62ad1ce21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.430767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7edaed1382420ba9d10d0eb032a14a', 'request_id': 'req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:56.437741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6fcc3a5d-22d0-4ebc-9f31-fe62ad1ce21b None None] MFA Rules not processed for user `57ed1d6da1454701a0b132f0b72f3fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:56.440368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7edaed1382420ba9d10d0eb032a14a', 'request_id': 'req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:56.441008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6fcc3a5d-22d0-4ebc-9f31-fe62ad1ce21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.522045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7edaed1382420ba9d10d0eb032a14a', 'request_id': 'req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:56.543952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] The token cache is being invalidate because project ea7edaed1382420ba9d10d0eb032a14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:56.544250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:56.546653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:56.551129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 889/1753] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:55 2022] DELETE /identity/v3/projects/ea7edaed1382420ba9d10d0eb032a14a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:56.554729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.554729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.570741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 865/1754] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:56.570741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc17-95c1-44a2-ac57-65a3e854c54b None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.570741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc17-95c1-44a2-ac57-65a3e854c54b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.570741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbc17-95c1-44a2-ac57-65a3e854c54b None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.581779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 866/1755] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 5 10:53:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:53:56.583996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.584875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.585154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.625876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] MFA Rules not processed for user `76d057c5f1ca479d87271cc0ed710c12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:56.628101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.653800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cd3d6-fc96-4f8d-af93-4ebb5f1c831f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.660913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.662275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.662739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.663266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.664081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:56.667631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:56.715441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 867/1756] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:56.716363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.725308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.741293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dfbc2-5af7-4c3c-aa53-dc81b9a7bf3b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.748062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.750280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.750739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.751046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.751702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:56.753996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:56.813354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 890/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:56 2022] POST /identity/v3/users => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:56.813354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.816970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.835552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8508b-bc36-4521-b573-26ff55484401 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.839425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:56.844264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.845094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.845517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.845869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] PATH_INFO: `/v3/users/a1f0629195a4441fb188d8a257bcd759` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:56.847118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f0629195a4441fb188d8a257bcd759)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:56.850976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:56.889335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 868/1758] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:56.889335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:56.891077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:56.980826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10833986-4516-46b2-8748-32e7cd81aeac admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:56.984856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:56.985487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:56.985776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:56.986046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:57.063819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:57.065294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784a86b-5e8f-44aa-b1eb-dedf72469904 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:57.075551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 869/1759] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:57.076921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:57.077765 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:57.078036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:57.098890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:57.100114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.204532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 870/1760] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 5 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:57.205502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:57.239970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f0629195a4441fb188d8a257bcd759'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:57.241254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f0629195a4441fb188d8a257bcd759'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:57.284387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f0629195a4441fb188d8a257bcd759'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:57.329390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f0629195a4441fb188d8a257bcd759'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:57.330737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f0629195a4441fb188d8a257bcd759'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:57.414011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d73794-928c-4bb4-818f-593b2de794c0 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:57.414744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 891/1761] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:56 2022] DELETE /identity/v3/users/a1f0629195a4441fb188d8a257bcd759 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:57.415698 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:57.422734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.625575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:57.626219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:57.626708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:57.626809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:57.627394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:57.629089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:57.636767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d012-4783-4ab5-9bdd-722f8477973f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:57.643675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:57.644853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:57.645315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:57.645795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:57.647073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:57.649319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:57.661522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 871/1762] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:57.662576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:57.666812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.826131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 892/1763] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:53:57 2022] POST /identity/v3/users => generated 293 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:53:57.828078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:57.835802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.838729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083c93-d04d-4158-ade8-bacb75f38344 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:57.850564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:57.851196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:57.851471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:57.851764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:57.863466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.894049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:57.895679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:57.916726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 872/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:57.917589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:57.923232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:57.988452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d115-2f31-4649-8447-53cad55d330e service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.002953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343e9e-6781-42b4-815a-39e8dfd917a6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.005868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.005868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.006596 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.008912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] PATH_INFO: `/v3/projects/2dc0a1ff57be471289ca83c3e0d52080/users/a39dc48832b048d3a8d9d28c884a3400/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.017886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.018578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.018865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.019142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.021731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:58.048781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc0a1ff57be471289ca83c3e0d52080, user_id=a39dc48832b048d3a8d9d28c884a3400, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.055075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.169228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.171425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.201524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 893/1765] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:58.206805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:58.285575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451291c-c909-4f2f-a693-5445e1cbab92 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.285575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.285575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.285575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.286898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.286898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.286898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.286898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 894/1766] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:58.299359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:58.312523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9dc3-090f-4648-b741-785f96a26528 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.319097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.319697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.320063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.320252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] PATH_INFO: `/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5/users/356ec922ce3746f89c57d677792bbe0d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.376776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2334e9c0a54784b6cd454f78ee48c5, user_id=356ec922ce3746f89c57d677792bbe0d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.376776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.656737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 873/1767] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:57 2022] PUT /identity/v3/projects/2dc0a1ff57be471289ca83c3e0d52080/users/a39dc48832b048d3a8d9d28c884a3400/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:58.657720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:58.658291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 895/1768] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:58 2022] PUT /identity/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5/users/356ec922ce3746f89c57d677792bbe0d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:58.665693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:58.665798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:58.859114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa7e2-b3e5-4d71-a23d-a6bb2d6d7873 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.875772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1952-9d95-4faf-b3e1-5add011787cb admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.876310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.876310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.876310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.876310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] PATH_INFO: `/v3/projects/f025ad097ace4af4adfd90eee04bcc11` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.877222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f025ad097ace4af4adfd90eee04bcc11)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.879216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.882026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.884837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.885288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.886278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.888242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.890661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.932646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 896/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:58.937361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:58.972128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938826e-e637-4ee1-b773-65747ebe6458 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:58.980331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:58.981430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:58.981949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:58.982416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:58.983586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:58.985411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:58.996959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 897/1770] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:53:58.997976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:59.012256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eda94-428b-4eb0-b864-0540c16134a1 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:59.018097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:59.018763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.019040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.019309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] PATH_INFO: `/v3/projects/2dc0a1ff57be471289ca83c3e0d52080/users/a39dc48832b048d3a8d9d28c884a3400/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.026631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc0a1ff57be471289ca83c3e0d52080, user_id=a39dc48832b048d3a8d9d28c884a3400, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:59.026631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:59.036767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 898/1771] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:58 2022] PUT /identity/v3/projects/2dc0a1ff57be471289ca83c3e0d52080/users/a39dc48832b048d3a8d9d28c884a3400/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:59.038018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:59.113114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9dfc8-a7cb-49a3-ad9f-9c9154eff9a8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:59.125701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f025ad097ace4af4adfd90eee04bcc11', 'request_id': 'req-cfe9a593-4763-4601-a974-8c0a3a1c223c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.133530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f025ad097ace4af4adfd90eee04bcc11', 'request_id': 'req-cfe9a593-4763-4601-a974-8c0a3a1c223c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.195351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:59.196192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.196474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.196888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] PATH_INFO: `/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5/users/356ec922ce3746f89c57d677792bbe0d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.199623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2334e9c0a54784b6cd454f78ee48c5, user_id=356ec922ce3746f89c57d677792bbe0d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:59.203878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36337ed5-24a6-4272-892f-1953b9ee3d7f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:59.221150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f025ad097ace4af4adfd90eee04bcc11', 'request_id': 'req-cfe9a593-4763-4601-a974-8c0a3a1c223c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.258028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] The token cache is being invalidate because project f025ad097ace4af4adfd90eee04bcc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:53:59.262737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.272333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cfe9a593-4763-4601-a974-8c0a3a1c223c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.283755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 874/1772] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:53:58 2022] DELETE /identity/v3/projects/f025ad097ace4af4adfd90eee04bcc11 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:59.286108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a379-6fe7-48d0-b168-c0036f185e26 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.289247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a379-6fe7-48d0-b168-c0036f185e26 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.290269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6a379-6fe7-48d0-b168-c0036f185e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.303501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 899/1773] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:53:59 2022] PUT /identity/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5/users/356ec922ce3746f89c57d677792bbe0d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:53:59.306138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.306431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.306707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.398649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:59.403287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.410523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-faa6a379-6fe7-48d0-b168-c0036f185e26 None None] MFA Rules not processed for user `a39dc48832b048d3a8d9d28c884a3400`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:59.412302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-faa6a379-6fe7-48d0-b168-c0036f185e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.505341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 900/1774] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:59.506239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:59.508034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.522082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d11b3-b6d0-40fe-996d-8ca8633d3d22 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:59.527959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:59.528655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.530736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.530736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] PATH_INFO: `/v3/users/893c537460704361928fa5c3089a3906` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.530736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893c537460704361928fa5c3089a3906)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:59.532948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:59.558694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:59.584552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 875/1775] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:59.596823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc167d9-bba8-4717-91d3-d7698bfe5a2f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.596823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc167d9-bba8-4717-91d3-d7698bfe5a2f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.596823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc167d9-bba8-4717-91d3-d7698bfe5a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.653466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3bc167d9-bba8-4717-91d3-d7698bfe5a2f None None] MFA Rules not processed for user `356ec922ce3746f89c57d677792bbe0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:59.654808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3bc167d9-bba8-4717-91d3-d7698bfe5a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.755892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 876/1776] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:59.757749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.758406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.758757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.791724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:53:59.793345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.803225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 877/1777] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:53:59.804349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:59.805833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.870072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4da21-ec38-4204-a0ae-9bc77444ef25 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:59.874312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:59.874955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.875231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.875537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.885160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:53:59.891433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:53:59.903195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 878/1778] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:53:59.904275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:53:59.907819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893c537460704361928fa5c3089a3906'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.908826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893c537460704361928fa5c3089a3906'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.917588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893c537460704361928fa5c3089a3906'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.918585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:53:59.934246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:53:59.941662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a00f-603d-4d41-81ed-cbe745c2fb21 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:53:59.962951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893c537460704361928fa5c3089a3906'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.965904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-da9d478a-abda-4439-a372-909059c20e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893c537460704361928fa5c3089a3906'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:53:59.968725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:53:59.969371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:53:59.969646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:53:59.969914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:53:59.984833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.021615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.023260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.040255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 879/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:00.041719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.043147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.074547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d46db-f99d-4bff-9bcd-4cee76642796 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.085330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.086140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.086432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.086826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.087364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:00.087665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.089581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.106100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 880/1780] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:00.116298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.122169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72900a-c038-4307-aa99-c671540de269 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.129584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.130534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.130895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.131304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.140999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 901/1781] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:53:59 2022] DELETE /identity/v3/users/893c537460704361928fa5c3089a3906 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:00.145052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.145052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.148415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.148954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.149302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.178687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:00.180078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.254499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 902/1782] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:00.263399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.265625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.329020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 881/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:00 2022] POST /identity/v3/projects => generated 357 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:00.329934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.409133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811aad-ec85-4618-9fce-bfaa9bf3ff6b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.486168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.486929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.487343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.487697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.501018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f2bd6-4cd7-4870-b8dc-0140bba88d48 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.504665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.506352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.506808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.507430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.507763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.508091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.508778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.511246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.526695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 903/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:00.527838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.529427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.641383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c29d7-1233-4631-84dd-ec9d9b80b952 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.650614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.651277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.651558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.651834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.656212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.711018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 882/1785] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:00 2022] POST /identity/v3/users => generated 279 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:00.711883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.713499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.765843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.766871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.769538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116d932-b67b-4f8c-82a0-579dd64fd696 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.778439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.779583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.785088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.785394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.789568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:00.801997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 904/1786] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:00.803195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.844730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca8aa0-3005-4eae-a8d7-e247d663392d service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.865856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.866275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.866558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.866834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.867483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.869776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.887905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:00.909901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 905/1787] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:00.911669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:00.943409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d337ba-b089-4a7f-a626-3f0f63419d07 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:00.963690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:00.964672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:00.965284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:00.965906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:00.970864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:00.973564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:00.985772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 906/1788] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:00.991538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:01.005702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:01.008392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607e3d2-e3b0-4e8c-ad7f-a569bdff881a service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:01.027377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4864412-c269-4526-a328-984afde79ba8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:01.042330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:01.042691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 883/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:00 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:01.043669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:01.044129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:01.044721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] PATH_INFO: `/v3/projects/f729b6a05a494864b886e1081068e6df/users/9a2d578556c74af085af1ca0892e1675/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:01.064542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f729b6a05a494864b886e1081068e6df, user_id=9a2d578556c74af085af1ca0892e1675, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:01.068625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:01.373020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 907/1790] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:00 2022] PUT /identity/v3/projects/f729b6a05a494864b886e1081068e6df/users/9a2d578556c74af085af1ca0892e1675/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:01.381088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:01.382129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:01.382564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:01.421318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] MFA Rules not processed for user `9a2d578556c74af085af1ca0892e1675`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:01.421318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:01.478055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:01.480843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:01.530971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 884/1791] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:01.535510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:01.653140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59508b-5d40-4385-89f1-788637de096c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:01.670307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:01.671230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:01.671802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:01.672787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] PATH_INFO: `/v3/projects/22dc72a8dbeb45df8e9a9311f3dee17e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:01.676224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=22dc72a8dbeb45df8e9a9311f3dee17e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:01.681836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:01.736385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf0c21-0e33-485b-b52b-78fff1516f1a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:01.750686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:01.751324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:01.751607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:01.751880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:01.753005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:01.755230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:01.888446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 885/1792] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:01 2022] POST /identity/v3/projects => generated 357 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:01.893466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:01.939986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22dc72a8dbeb45df8e9a9311f3dee17e', 'request_id': 'req-b637ecd8-95c2-4872-a16a-4891061ff2ae'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:01.962654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22dc72a8dbeb45df8e9a9311f3dee17e', 'request_id': 'req-b637ecd8-95c2-4872-a16a-4891061ff2ae'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.004336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa14520-6564-4eaf-ab6e-c9e6018e9bdf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.061712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.062333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.062611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.062884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.063519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.065456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.157339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22dc72a8dbeb45df8e9a9311f3dee17e', 'request_id': 'req-b637ecd8-95c2-4872-a16a-4891061ff2ae'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.179851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] The token cache is being invalidate because project 22dc72a8dbeb45df8e9a9311f3dee17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:02.189589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.189589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.189589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 908/1793] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:01 2022] DELETE /identity/v3/projects/22dc72a8dbeb45df8e9a9311f3dee17e => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:02.194097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:02.195917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:02.227693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 886/1794] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:01 2022] POST /identity/v3/users => generated 285 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:02.237158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:02.248334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637ecd8-95c2-4872-a16a-4891061ff2ae admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.251505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:02.282034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.282907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.283330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.283746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] PATH_INFO: `/v3/users/57ed1d6da1454701a0b132f0b72f3fbe` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.287429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ed1d6da1454701a0b132f0b72f3fbe)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.290187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.290919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204bd21-362e-4877-b630-093be0ae5f4d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.303672 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.304310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.306834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.307126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.307798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.310455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.336023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 887/1795] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:02.340467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:02.361381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d77be-33a3-4cd8-b907-28b7518d5691 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.363449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.364964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.365402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.365953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] PATH_INFO: `/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256/users/d1d0be617e57433ea3b6973d00d05a90/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.411756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9e0dfc72f54e42a814e8f5d325f256, user_id=d1d0be617e57433ea3b6973d00d05a90, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.415076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.577483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 888/1796] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:02 2022] PUT /identity/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256/users/d1d0be617e57433ea3b6973d00d05a90/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:02.583687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:02.697488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ed1d6da1454701a0b132f0b72f3fbe'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.699524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ed1d6da1454701a0b132f0b72f3fbe'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.712045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ed1d6da1454701a0b132f0b72f3fbe'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.721164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4740-794f-4715-873c-41a947ccf99d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.727242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.727976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.728472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.728892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.729865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.731654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.742264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ed1d6da1454701a0b132f0b72f3fbe'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.743399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-782ae6dc-e04c-44c2-b93c-dc7764b7c42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ed1d6da1454701a0b132f0b72f3fbe'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:02.747201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 889/1797] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:02.748208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:02.750995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:02.766294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb5026-871c-4716-9780-7276d9e9a7f4 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:02.771549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:02.772224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.772504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.772825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] PATH_INFO: `/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256/users/d1d0be617e57433ea3b6973d00d05a90/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.774788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9e0dfc72f54e42a814e8f5d325f256, user_id=d1d0be617e57433ea3b6973d00d05a90, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:02.777581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba71914-f065-40c7-abe3-1c41f520ac32 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:02.790351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 890/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:02 2022] PUT /identity/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256/users/d1d0be617e57433ea3b6973d00d05a90/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:02.802452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:02.802452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:02.802452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:02.838618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] MFA Rules not processed for user `d1d0be617e57433ea3b6973d00d05a90`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:02.840559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:02.891836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 909/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:02 2022] DELETE /identity/v3/users/57ed1d6da1454701a0b132f0b72f3fbe => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:03.062033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 891/1800] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:03.076325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:03.076325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:03.076325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:03.088831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:03.093368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:03.208567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:03.214194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:03.251197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbec669-8048-4a4e-9549-a8ea802dbf3d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:03.353245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:03.353245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:03.353245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:03.353245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:03.383724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 910/1801] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:03.432169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:03.434128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:03.453799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 892/1802] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:03.967164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:03.972356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:04.029813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:04.145756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e38cc-255f-4dfd-ab63-de039c0f57d3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:04.168880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:04.172249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:04.182764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:04.183115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:04.183758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca883c-f28c-4678-ada7-ffaf80ba674b service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:04.187902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:04.200687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:04.200687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:04.200687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:04.215388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:04.229518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:04.241102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:04.252142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857a4f-0e66-43a0-ad19-ba68e062f133 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:04.287657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 911/1803] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:54:04.408868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:04.410745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:04.428078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 893/1804] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:04.459214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:04.460182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:04.461236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:04.536097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:04.543338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:04.567236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:04.597114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:04.599978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:04.753168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 912/1805] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Sep 5 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:04.857430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167c08-61fc-4cb9-b782-da9a57a2d9c2 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:04.871693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:04.872529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:04.881155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:04.881597 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] PATH_INFO: `/v3/projects/b0be07d5701248e783850e344dcdf42e` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:04.884292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0be07d5701248e783850e344dcdf42e)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:04.886951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:05.151147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0be07d5701248e783850e344dcdf42e', 'request_id': 'req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:05.166894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0be07d5701248e783850e344dcdf42e', 'request_id': 'req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:05.169713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:05.171831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:05.188532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0a8ad-ea19-409d-9237-52c7db02026d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:05.306761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0be07d5701248e783850e344dcdf42e', 'request_id': 'req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:05.334245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] The token cache is being invalidate because project b0be07d5701248e783850e344dcdf42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:05.334537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:05.335965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f36df2f9-7915-42ff-a4af-4e1f9ab4273a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:05.343973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 894/1806] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:04 2022] DELETE /identity/v3/projects/b0be07d5701248e783850e344dcdf42e => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:05.347015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:05.349722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:05.350861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:05.350861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:05.354753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:05.356465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:05.356836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:05.362108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:05.416098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:05.417830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb070dc-b2b7-4592-a4e9-e8644abaeb53 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:05.429409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:05.432428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:05.448722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 913/1807] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:05.558775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 895/1808] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:05.567793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:05.568143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:05.568667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:05.611027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:05.612266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:05.645991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 914/1809] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:05.651524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:05.665825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52246dc7-2d00-4a37-8d78-c0fce92e7282 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:05.673868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:05.675070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:05.675676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:05.678757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:05.680734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:05.680734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:05.682647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:05.703285 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 896/1810] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:05.707442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:05.731260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e297db0-88cd-4df0-8397-496e59ea6315 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:05.752553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:05.753298 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:05.753516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:05.753770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:05.754429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:05.762324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:06.194942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 915/1811] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:05 2022] POST /identity/v3/projects => generated 385 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:06.200789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:06.248246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6253b3-df19-4b12-a45c-620644a516b7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:06.372885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:06.373894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:06.374659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:06.375101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:06.375914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:06.387905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:06.492172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 897/1812] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:06 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:06.495895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:06.510982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcb463-5a2e-4f0b-bb52-85071d32faa0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:06.532972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:06.536645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:06.536645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:06.536645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:06.536645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:06.541120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:06.565187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 916/1813] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:06.572619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:06.603808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51a450-ca77-4d5d-92ae-9808aaaa45a3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:06.615147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:06.616162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:06.617182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:06.629563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:06.629563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:06.629563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480a381-0a31-442b-9dbc-65c6899d6cd7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:06.659595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:06.659868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 898/1814] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:06.669491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52f439-a709-494f-a539-996f6febbce9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:06.685016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:06.685884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:06.690977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:06.691502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] PATH_INFO: `/v3/projects/0ce164ce9199451c8e7e1930e3a7cf71/users/089efec40b044247be8af626c1e1bd80/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:06.732182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce164ce9199451c8e7e1930e3a7cf71, user_id=089efec40b044247be8af626c1e1bd80, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:06.732182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:06.852321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 917/1815] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:06 2022] PUT /identity/v3/projects/0ce164ce9199451c8e7e1930e3a7cf71/users/089efec40b044247be8af626c1e1bd80/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:06.866461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:06.867035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:06.867657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:06.975802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] MFA Rules not processed for user `089efec40b044247be8af626c1e1bd80`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:06.975802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:07.187073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 899/1816] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:07.191485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:07.367949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852732ca-08e8-440e-ac4b-ac4d4e85440b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:07.375713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:07.378709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.378709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.378709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.378709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:07.380946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:07.402317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:07.558917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 918/1817] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:07 2022] POST /identity/v3/projects => generated 383 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:07.562939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:07.577131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b392dd2-d253-4ea8-8b15-297b99bfb245 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:07.663896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:07.666045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.666506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.666934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.668363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:07.672419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:07.805945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 900/1818] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:07 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:07.807452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:07.818800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791363cc-904a-49bf-a0c5-8769ef3afb08 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:07.824554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:07.825941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.825941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.825941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.826482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:07.828125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:07.839387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 919/1819] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:07.843601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:07.855438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7e3f3-59d9-4f84-a825-ad747ba208ee admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:07.866248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:07.867363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.867873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.868243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.869336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:07.871179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eae6e-7b6f-4a22-a918-6e0b6c5ffc7d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:07.887970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 901/1820] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:07.888288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:07.899390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b7ce-b507-4c85-83c2-8d0fd86ca7c5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:07.903946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:07.904654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.904940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.905216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] PATH_INFO: `/v3/projects/df41922710f84033a98537c6831b1080/users/3ae2fc21aad14af2ab499ee83488a9cd/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.923550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=df41922710f84033a98537c6831b1080, user_id=3ae2fc21aad14af2ab499ee83488a9cd, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:07.924129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadbfcb-0308-4250-a2f8-e158999405ee admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:07.960426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c90a3-b244-4d0e-b700-9e28bfebb642 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.960653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c90a3-b244-4d0e-b700-9e28bfebb642 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.961110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c90a3-b244-4d0e-b700-9e28bfebb642 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:07.962667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 902/1821] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:54:07.981788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:07.982069 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:07.983644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.005247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:08.006975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:08.037010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 920/1822] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:07 2022] PUT /identity/v3/projects/df41922710f84033a98537c6831b1080/users/3ae2fc21aad14af2ab499ee83488a9cd/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:08.053766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.054053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.054326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.079089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 903/1823] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:08.082564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] MFA Rules not processed for user `3ae2fc21aad14af2ab499ee83488a9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:08.084415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:08.094530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.096141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:08.130610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5acdc-f69b-4357-b559-2a8f68d4dc27 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:08.189398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 921/1824] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:08.192735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.293280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:08.296754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.296754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.296754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.298730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b9a1-de98-4850-ac88-3c0e91a0c490 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:08.305390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:08.306006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.306286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.306558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.307265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:08.309481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:08.321824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:08.325431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:08.346577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 904/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:08.420408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 922/1826] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:08 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:08.424813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.442153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c640cf1-75f1-42b9-b3f4-1e581c1c6c4d service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:08.513500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:08.514646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.514646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.514834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.515470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:08.517493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:08.674238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 905/1827] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:08 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:08.678257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.689562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b041-5eb0-49ef-8b49-ae817cceabb4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:08.696003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:08.701343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.701678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.702319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.703197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:08.705311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:08.717310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 923/1828] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:08.721761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.735981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073aa16-bd2c-4fae-a492-39dd9d0d3958 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:08.758232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:08.758923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:08.759200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:08.762850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] PATH_INFO: `/v3/projects/60bb49d8ffac4a69a019becec6677834/users/45e0b10aba9942079a5e2c85ee19d2f0/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:08.799772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bb49d8ffac4a69a019becec6677834, user_id=45e0b10aba9942079a5e2c85ee19d2f0, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:08.806158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:08.940500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 906/1829] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:08 2022] PUT /identity/v3/projects/60bb49d8ffac4a69a019becec6677834/users/45e0b10aba9942079a5e2c85ee19d2f0/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:08.944668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:08.962216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8489c-fefe-4cb7-8f93-887cfc3dd353 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:09.025429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:09.026198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:09.026596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:09.026978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:09.027728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:09.030067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1a6e0-e8d0-4daf-89c7-c7278b123481 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:09.033624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:09.042853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 924/1830] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:09.049184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:09.064978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f88ed-77e3-46a1-a4ee-ad6fc6e585e3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:09.069782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:09.070528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:09.070905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:09.071243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] PATH_INFO: `/v3/projects/60bb49d8ffac4a69a019becec6677834/users/45e0b10aba9942079a5e2c85ee19d2f0/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:09.073538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bb49d8ffac4a69a019becec6677834, user_id=45e0b10aba9942079a5e2c85ee19d2f0, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:09.077351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:09.088223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 907/1831] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:09 2022] PUT /identity/v3/projects/60bb49d8ffac4a69a019becec6677834/users/45e0b10aba9942079a5e2c85ee19d2f0/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:09.099122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:09.099407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:09.099683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:09.128134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] MFA Rules not processed for user `45e0b10aba9942079a5e2c85ee19d2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:09.129439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:09.212865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 925/1832] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:09.225709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:09.227609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:09.305690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87cf81-5814-4a06-bfa9-e1f9674a8825 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:09.309907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:09.310632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:09.311199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:09.311625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:09.406845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:09.408543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:09.422134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 908/1833] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:09.796857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:13.525564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:13.528133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:13.541737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94224575-73dc-4fc7-83f9-4a43f181af63 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:13.547664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:13.547664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:13.547664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:13.547664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:13.620375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:13.621988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b079cb6-3f31-4b0d-a296-304110002d05 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:13.631965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 926/1834] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:13.659725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:14.305537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:16.411230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:16.413859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:16.509343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1380c-d6d0-4fb2-badc-748c9049eb66 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:16.513084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:16.514394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:16.514640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:16.515009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] PATH_INFO: `/v3/users/af471e72bf474b28ad5dd3c7dc19d860` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:16.517400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af471e72bf474b28ad5dd3c7dc19d860)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:16.519304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:16.737363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af471e72bf474b28ad5dd3c7dc19d860'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:16.737363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af471e72bf474b28ad5dd3c7dc19d860'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:16.751012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af471e72bf474b28ad5dd3c7dc19d860'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:16.752747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af471e72bf474b28ad5dd3c7dc19d860'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:16.785685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af471e72bf474b28ad5dd3c7dc19d860'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:16.973212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 909/1835] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:16 2022] DELETE /identity/v3/users/af471e72bf474b28ad5dd3c7dc19d860 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:16.976356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:16.977021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:16.977160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:16.981405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:16.990728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:17.026336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:17.028794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:17.085673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54998ab-740c-4168-b8f0-43cc4a8c7b08 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:17.090695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:17.091376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:17.092235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:17.093215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:17.095642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:17.137449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 927/1836] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:17.179207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:17.180946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:17.216564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:17.220522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d4fac-587f-48ce-aad0-04ad9022f9fa service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:17.252561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 910/1837] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:17.287794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ea3c-5d42-4789-a48f-4e97a09e63ac None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:17.301123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:17.311563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:17.311563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:17.311563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:17.317717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:17.319809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792500-79b8-44d2-8004-694f340b2bba service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:17.332122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 928/1838] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:17.340553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:17.753719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:18.756348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:18.935992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:18.936293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:18.936540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:18.939788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 911/1839] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:54:18.999772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:19.000325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:19.000713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:19.032952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:19.034328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:19.122754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 929/1840] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:19.153659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:19.158465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:19.179728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126cd00-6643-420c-9bd1-c480f6e9a14d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:19.211259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:19.213249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:19.217267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:19.217636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:19.231035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:19.234474 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:19.249029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 912/1841] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:19.289998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:19.291552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:19.349455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d4a28-0c0c-482c-9282-7123cb575311 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:19.362009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:19.365988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:19.368529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:19.369303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] PATH_INFO: `/v3/projects/4a50f0f47b5a4908975faea94d8a93c8` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:19.374750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a50f0f47b5a4908975faea94d8a93c8)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:19.381557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:19.567731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a50f0f47b5a4908975faea94d8a93c8', 'request_id': 'req-7a4d7fba-0776-4f39-af92-9ef0a9114735'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:19.577028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a50f0f47b5a4908975faea94d8a93c8', 'request_id': 'req-7a4d7fba-0776-4f39-af92-9ef0a9114735'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:19.699070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a50f0f47b5a4908975faea94d8a93c8', 'request_id': 'req-7a4d7fba-0776-4f39-af92-9ef0a9114735'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:19.722480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] The token cache is being invalidate because project 4a50f0f47b5a4908975faea94d8a93c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:19.725110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:19.726233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:19.728247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 930/1842] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:19 2022] DELETE /identity/v3/projects/4a50f0f47b5a4908975faea94d8a93c8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:19.733081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:19.745759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4129d-931b-4fab-9374-8515a0de40ab service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:19.830400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:19.831101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:19.831483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:19.831831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] PATH_INFO: `/v3/users/a39dc48832b048d3a8d9d28c884a3400` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:19.833732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39dc48832b048d3a8d9d28c884a3400)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:19.836357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:19.880443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:20.042677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39dc48832b048d3a8d9d28c884a3400'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:20.043693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39dc48832b048d3a8d9d28c884a3400'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:20.055465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39dc48832b048d3a8d9d28c884a3400'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:20.058312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39dc48832b048d3a8d9d28c884a3400'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:20.071973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bfe736ff-c4d7-4c8f-8c07-007b6c26e9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39dc48832b048d3a8d9d28c884a3400'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:20.151447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 913/1843] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:19 2022] DELETE /identity/v3/users/a39dc48832b048d3a8d9d28c884a3400 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:20.299362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:20.965296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:20.973283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:20.995722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7fba-0776-4f39-af92-9ef0a9114735 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:21.064253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:21.064961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:21.065204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:21.065483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] PATH_INFO: `/v3/projects/2dc0a1ff57be471289ca83c3e0d52080` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:21.066624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc0a1ff57be471289ca83c3e0d52080)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:21.068674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:21.338572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc0a1ff57be471289ca83c3e0d52080', 'request_id': 'req-e7db6cc7-0390-48f5-9699-fd7d5689daba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:21.346286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc0a1ff57be471289ca83c3e0d52080', 'request_id': 'req-e7db6cc7-0390-48f5-9699-fd7d5689daba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:21.487374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc0a1ff57be471289ca83c3e0d52080', 'request_id': 'req-e7db6cc7-0390-48f5-9699-fd7d5689daba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:21.505924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] The token cache is being invalidate because project 2dc0a1ff57be471289ca83c3e0d52080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:21.506286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:21.507169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e7db6cc7-0390-48f5-9699-fd7d5689daba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:21.509485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 931/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:20 2022] DELETE /identity/v3/projects/2dc0a1ff57be471289ca83c3e0d52080 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:21.514972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:21.515428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:21.515739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:21.557657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:21.559046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:21.666927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 914/1845] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:21.674762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:21.675278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:21.675855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:21.698914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:21.700126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:21.709211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 932/1846] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:21.713391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:21.724021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d0b9-5443-4012-8a9e-526fe00ba210 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:21.728861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:21.729483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:21.729746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:21.730019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:21.730699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:21.731003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:21.733831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:21.745531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 915/1847] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:21.749989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:21.759306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd27aa-57b1-455f-a2ee-1e53e4658520 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:21.764729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:21.765365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:21.765687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:21.765929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:21.766572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:21.768514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.015257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.021429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 933/1848] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:21 2022] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:22.025411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1632b3b-04b8-4a55-b864-21fff3db0430 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.108029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.108670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.108947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.109268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.109839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.111816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.287476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 916/1849] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:22 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:22.291780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.302704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c794e-eae8-43f5-a2c4-a7b84dbdd105 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.307485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.308145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.308571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.309057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.313288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.313288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.322982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 934/1850] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:22.327758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.338018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09431a-4e37-4396-a177-289d275c3723 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.343006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.343606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.343880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.344150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.344825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.346420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fef47-b40f-4fc1-9df8-206cfaf41d34 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.357106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 917/1851] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:22.361327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.371423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797faf-5c91-4032-a223-b81e31b3b827 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.376857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.377551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.377877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.378147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] PATH_INFO: `/v3/projects/81a35112e92a4273937dd7a4a44efb59/users/c414fc88910748a4b795475f31e18db6/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.393433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a35112e92a4273937dd7a4a44efb59, user_id=c414fc88910748a4b795475f31e18db6, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.396203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.520855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 935/1852] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:22 2022] PUT /identity/v3/projects/81a35112e92a4273937dd7a4a44efb59/users/c414fc88910748a4b795475f31e18db6/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:22.531196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.531802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.531802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.564811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] MFA Rules not processed for user `c414fc88910748a4b795475f31e18db6`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:22.566034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:22.630489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:22.634420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 918/1853] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:22.643861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.707179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a18c37-165c-4071-b879-cb614f3cf203 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.712089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.712732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.713025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.713309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.713947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.715889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:22.887068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 936/1854] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:22 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:22.888937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:22.899524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9484686-52ad-4aba-8f2d-b78339b74fa9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:22.956658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:22.957206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:22.957482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:22.957750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:22.958939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:22.960985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.130760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 919/1855] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:22 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:23.134743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.146211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce69aa-eb36-4759-8276-6871d9d093c4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.151161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.151870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.152219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.152554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.153305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.155291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.170807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 937/1856] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:23.171994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.182184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063398ac-57f0-462a-9fc9-fc9d253c51d8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.187496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.188175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.188499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.188800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] PATH_INFO: `/v3/projects/0166edea6fd1451bb4c67083e5e308a9/users/26d9c78e7ca344fd97f1b8c8f9f8ce44/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.204218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0166edea6fd1451bb4c67083e5e308a9, user_id=26d9c78e7ca344fd97f1b8c8f9f8ce44, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.207002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.266826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 920/1857] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:23 2022] PUT /identity/v3/projects/0166edea6fd1451bb4c67083e5e308a9/users/26d9c78e7ca344fd97f1b8c8f9f8ce44/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:23.278593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.290406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579c79-55a4-4947-b2b8-bbc8234a5162 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.349646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.350275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.350876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.351184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.351836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.353478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06e714-5269-444f-8068-70c9b92383c6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.364144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 938/1858] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:23.368294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.380751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea94-6500-46c9-a0e2-789a589bfb2d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.397647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.398880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.399309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.400328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] PATH_INFO: `/v3/projects/0166edea6fd1451bb4c67083e5e308a9/users/26d9c78e7ca344fd97f1b8c8f9f8ce44/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.403005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0166edea6fd1451bb4c67083e5e308a9, user_id=26d9c78e7ca344fd97f1b8c8f9f8ce44, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.409648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.425319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 921/1859] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:23 2022] PUT /identity/v3/projects/0166edea6fd1451bb4c67083e5e308a9/users/26d9c78e7ca344fd97f1b8c8f9f8ce44/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:23.437185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.437471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.437742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.469058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] MFA Rules not processed for user `26d9c78e7ca344fd97f1b8c8f9f8ce44`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:23.475744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:23.527807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:23.577082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 939/1860] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:23.581020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.583577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:23.603336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:23.605029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:23.702384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8054d-7541-4e3b-9f77-2957b737ef5f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.707571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7645ac-6f46-406e-a6a8-96991655da99 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:23.707725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.708728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.709469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.709751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.718185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:23.718185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.718185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.718185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] PATH_INFO: `/v3/users/089efec40b044247be8af626c1e1bd80` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.719520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089efec40b044247be8af626c1e1bd80)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.723231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:23.724668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.724804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9321f96-d0e0-40e8-938b-8b6114b5c919 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:23.747814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 940/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:23.872956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718fbfc-e000-4295-96b0-32a60c3fd7db None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.873899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718fbfc-e000-4295-96b0-32a60c3fd7db None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.874380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718fbfc-e000-4295-96b0-32a60c3fd7db None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.878717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 941/1862] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:54:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:54:23.882993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:23.883434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:23.884115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:23.931175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:23.932767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.101077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 942/1863] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:24.160222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:24.162781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.182965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089efec40b044247be8af626c1e1bd80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:24.184371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089efec40b044247be8af626c1e1bd80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:24.186452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f28b-f5a9-49e3-9fde-f6b5657d0270 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:24.204158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089efec40b044247be8af626c1e1bd80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:24.204158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089efec40b044247be8af626c1e1bd80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:24.215296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:24.215937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:24.216217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:24.216726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:24.218804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.231169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2709480-4c87-4da1-8a9f-9757b66b02d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089efec40b044247be8af626c1e1bd80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:24.234635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:24.236694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:24.251001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 943/1864] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:24.252451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:24.254323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.267936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e2429-4dd5-4000-a9a4-6807f463666d service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:24.274083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:24.274830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:24.277901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:24.277901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:24.279363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.361144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 922/1865] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:23 2022] DELETE /identity/v3/users/089efec40b044247be8af626c1e1bd80 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:24.362542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:24.362858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:24.363102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:24.369509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:24.370975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:24.382859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 944/1866] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:24.389702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:24.391209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.470176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 923/1867] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:24.485021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:24.486811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:24.575525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341dbbf-2fa5-41a8-babc-5a499decfb31 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:24.644776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:24.645408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:24.645720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:24.646108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:24.660436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:24.661876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:24.674663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 945/1868] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:24.996410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:25.223353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:25.225641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:25.269934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d599b8-e1eb-4ac1-a8b9-0fff15abbe73 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:25.293369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:25.295643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:25.296867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:25.297289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] PATH_INFO: `/v3/projects/0ce164ce9199451c8e7e1930e3a7cf71` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:25.301099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce164ce9199451c8e7e1930e3a7cf71)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:25.303277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:25.494790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce164ce9199451c8e7e1930e3a7cf71', 'request_id': 'req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:25.502986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce164ce9199451c8e7e1930e3a7cf71', 'request_id': 'req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:25.589696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce164ce9199451c8e7e1930e3a7cf71', 'request_id': 'req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:25.604209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] The token cache is being invalidate because project 0ce164ce9199451c8e7e1930e3a7cf71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:25.604490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:25.605483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:25.608942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 924/1869] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:25 2022] DELETE /identity/v3/projects/0ce164ce9199451c8e7e1930e3a7cf71 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:25.611709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:25.622172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61087a-2878-42c8-847b-c6a60330f62c service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:25.715961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:25.717486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:25.721393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:25.721971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] PATH_INFO: `/v3/users/3ae2fc21aad14af2ab499ee83488a9cd` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:25.736034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae2fc21aad14af2ab499ee83488a9cd)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:25.742573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:25.813797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:26.023950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae2fc21aad14af2ab499ee83488a9cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:26.025622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae2fc21aad14af2ab499ee83488a9cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:26.034537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae2fc21aad14af2ab499ee83488a9cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:26.050170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae2fc21aad14af2ab499ee83488a9cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:26.052069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae2fc21aad14af2ab499ee83488a9cd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:26.157881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 946/1870] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:25 2022] DELETE /identity/v3/users/3ae2fc21aad14af2ab499ee83488a9cd => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:26.782742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:26.785013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:26.800513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d2a0-7d43-40b7-9a8f-a1230207b4e9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:26.885357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:26.891425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:26.891713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:26.891982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] PATH_INFO: `/v3/projects/df41922710f84033a98537c6831b1080` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:26.893518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df41922710f84033a98537c6831b1080)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:26.895791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:27.070973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df41922710f84033a98537c6831b1080', 'request_id': 'req-c11d140a-fa8c-400c-8d92-22e43ffed0cc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.089657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df41922710f84033a98537c6831b1080', 'request_id': 'req-c11d140a-fa8c-400c-8d92-22e43ffed0cc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.293085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df41922710f84033a98537c6831b1080', 'request_id': 'req-c11d140a-fa8c-400c-8d92-22e43ffed0cc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.308759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] The token cache is being invalidate because project df41922710f84033a98537c6831b1080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:27.309457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.310721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.312713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 925/1871] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:26 2022] DELETE /identity/v3/projects/df41922710f84033a98537c6831b1080 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:27.316475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:27.318641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:27.331871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17059a-70d1-4278-8b0d-a632a97e52fd admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:27.393882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:27.394515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:27.394796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:27.395099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] PATH_INFO: `/v3/users/45e0b10aba9942079a5e2c85ee19d2f0` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:27.396237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e0b10aba9942079a5e2c85ee19d2f0)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:27.398353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:27.784278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e0b10aba9942079a5e2c85ee19d2f0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.785882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e0b10aba9942079a5e2c85ee19d2f0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.794202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e0b10aba9942079a5e2c85ee19d2f0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.807500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e0b10aba9942079a5e2c85ee19d2f0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.808212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7f91e9f5-c975-45af-bccc-1447aefd1c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e0b10aba9942079a5e2c85ee19d2f0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:27.897194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 947/1872] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:27 2022] DELETE /identity/v3/users/45e0b10aba9942079a5e2c85ee19d2f0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:28.649355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:28.650850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:28.670817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d140a-fa8c-400c-8d92-22e43ffed0cc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:28.751034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:28.751692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:28.751973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:28.752244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] PATH_INFO: `/v3/projects/60bb49d8ffac4a69a019becec6677834` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:28.753415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bb49d8ffac4a69a019becec6677834)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:28.755354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:28.930135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bb49d8ffac4a69a019becec6677834', 'request_id': 'req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:28.935904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bb49d8ffac4a69a019becec6677834', 'request_id': 'req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:29.076553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bb49d8ffac4a69a019becec6677834', 'request_id': 'req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:29.080577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:29.106449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] The token cache is being invalidate because project 60bb49d8ffac4a69a019becec6677834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:29.107242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:29.109691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c5eef62e-da5d-4614-bbf0-e905af1ad4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:29.114482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 926/1873] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:28 2022] DELETE /identity/v3/projects/60bb49d8ffac4a69a019becec6677834 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:29.116901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.117293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.117532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.153160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:29.153160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:29.222699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 948/1874] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:29.230819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.234918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.234918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.253389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:29.255548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:29.269533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 927/1875] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:29.270827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.297185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea33d2-336b-4d29-939f-944b2331c39c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.304816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.305752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.307985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.308534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.309224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:29.310496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.313021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:29.330719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 949/1876] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:29.331859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.352736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe2fe-f6be-49a6-84b7-75f7c0d323ec None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.352736 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.353710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.354000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.354279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.354909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.356866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:29.447736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:29.522005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 928/1877] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:29 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:29.527795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.550064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f837a-495e-46de-a400-73f01eeeeee8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.657227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.657227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.657227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.657227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.658507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.658507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:29.803122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 950/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:29 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:29.807303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.825499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25772d-43a1-4ff6-a1c5-70f99a099a7a admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.831720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.832364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.832676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.832951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.834671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.836933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:29.854377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.854575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 929/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:29.877137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1094b-ddb0-4e46-88e3-4d680095b9e5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.886003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.886634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.888423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.888423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.888423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.890513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d56512-f421-47d7-88ca-6ee9d9deacce admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:29.911703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 951/1880] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:29.916047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:29.931764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817b06-c7f5-49c7-a7b2-1278937ddda2 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:29.937261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:29.937922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:29.938198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:29.938470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] PATH_INFO: `/v3/projects/5016b6ad008d44b287ce9e52dac8611b/users/872f3e52ccc04e02ad316970ed9f7653/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:29.966953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5016b6ad008d44b287ce9e52dac8611b, user_id=872f3e52ccc04e02ad316970ed9f7653, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:29.969667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:30.189840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 930/1881] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:29 2022] PUT /identity/v3/projects/5016b6ad008d44b287ce9e52dac8611b/users/872f3e52ccc04e02ad316970ed9f7653/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:30.203088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:30.203615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:30.203615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:30.264141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] MFA Rules not processed for user `872f3e52ccc04e02ad316970ed9f7653`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:30.266386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:30.339750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 952/1882] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:30.351676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:30.353462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:30.486459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000d6cd-6d9a-4afd-bdb3-fb61d3cf2af8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:30.491135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:30.492025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:30.492563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:30.493088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:30.503576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:30.505293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ad7ef-a2e5-455a-b176-2c9c0db02a8f service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:30.522336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 931/1883] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:30.564172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:30.645703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc9649-8dc1-47a5-9df5-6c4a1b33a6d3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:30.650461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:30.651237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:30.651439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:30.651710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] PATH_INFO: `/v3/users/872f3e52ccc04e02ad316970ed9f7653` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:30.653130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872f3e52ccc04e02ad316970ed9f7653)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:30.655928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:30.943031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872f3e52ccc04e02ad316970ed9f7653'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:30.943708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872f3e52ccc04e02ad316970ed9f7653'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:30.953399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872f3e52ccc04e02ad316970ed9f7653'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:30.969231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872f3e52ccc04e02ad316970ed9f7653'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:30.970027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872f3e52ccc04e02ad316970ed9f7653'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:30.976520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:31.162969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 953/1884] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:30 2022] DELETE /identity/v3/users/872f3e52ccc04e02ad316970ed9f7653 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:31.166880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:31.166880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:31.167422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:31.186460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:31.188368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:31.249251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 932/1885] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:31.259484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:31.261201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:31.324937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814c05a-76ca-4e05-8c0d-4118e8ae8d61 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:31.329551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:31.330180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:31.331752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:31.331752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:31.340405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:31.341939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:31.351498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 954/1886] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:31.988772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:31.991152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.008500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264d8f7-cb55-483e-9e0b-c540d0908f9b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:32.014227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:32.014874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.015156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.015430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] PATH_INFO: `/v3/users/9a2d578556c74af085af1ca0892e1675` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.016754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2d578556c74af085af1ca0892e1675)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:32.018810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:32.047792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:32.262774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2d578556c74af085af1ca0892e1675'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.267531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2d578556c74af085af1ca0892e1675'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.276487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2d578556c74af085af1ca0892e1675'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.277248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2d578556c74af085af1ca0892e1675'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.292966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c3be2f87-9e81-4910-941d-4744ac204cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2d578556c74af085af1ca0892e1675'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.374701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:32.376278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.399302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e48d-fd79-438b-84e6-8f48ea8186e7 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:32.406408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 933/1887] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:31 2022] DELETE /identity/v3/users/9a2d578556c74af085af1ca0892e1675 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:32.412490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.413913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.414122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.461817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:32.463049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.489250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:32.489943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.490226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.490494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] PATH_INFO: `/v3/projects/5016b6ad008d44b287ce9e52dac8611b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.491689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5016b6ad008d44b287ce9e52dac8611b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:32.493691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:32.529151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 934/1888] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:32.538826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:32.540906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.597394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbb6d8-a5be-4e9d-89fc-61d028729926 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:32.601483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:32.602088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.602366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.602636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.613424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:32.614908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:32.625258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 935/1889] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:32.626510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:32.627788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.640169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c09f4-edab-4e71-9f4f-44d7e0e48ea8 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:32.646162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:32.646904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.647125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.647400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] PATH_INFO: `/v3/users/c414fc88910748a4b795475f31e18db6` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.648545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c414fc88910748a4b795475f31e18db6)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:32.650494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:32.725949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5016b6ad008d44b287ce9e52dac8611b', 'request_id': 'req-f0df659d-17e6-466a-a74e-e97ba66ab427'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.732271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5016b6ad008d44b287ce9e52dac8611b', 'request_id': 'req-f0df659d-17e6-466a-a74e-e97ba66ab427'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.807120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5016b6ad008d44b287ce9e52dac8611b', 'request_id': 'req-f0df659d-17e6-466a-a74e-e97ba66ab427'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.820323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] The token cache is being invalidate because project 5016b6ad008d44b287ce9e52dac8611b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:32.820910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.821811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f0df659d-17e6-466a-a74e-e97ba66ab427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.823512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 955/1890] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:32 2022] DELETE /identity/v3/projects/5016b6ad008d44b287ce9e52dac8611b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:32.828689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4eaca-46e0-4872-9b7e-d9535363f35b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.829062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4eaca-46e0-4872-9b7e-d9535363f35b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.829546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4eaca-46e0-4872-9b7e-d9535363f35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.851173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-25f4eaca-46e0-4872-9b7e-d9535363f35b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:32.852579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-25f4eaca-46e0-4872-9b7e-d9535363f35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.891846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c414fc88910748a4b795475f31e18db6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.892738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c414fc88910748a4b795475f31e18db6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.906775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c414fc88910748a4b795475f31e18db6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.907731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c414fc88910748a4b795475f31e18db6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.929120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8b619a05-d889-4f10-909d-f22dfd2be606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c414fc88910748a4b795475f31e18db6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:32.938418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 956/1891] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:32.948047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:32.948510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:32.949047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:32.977338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:32.979105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:32.999665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 957/1892] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:33.003711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.012270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bee247-e3fd-46ae-96e0-27c4f667f06c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.018002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.018627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.018910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.019183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.019849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:33.020160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.021912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.037109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 958/1893] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:33.041310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.051757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75fc30-e78e-48ff-ac96-0131fed9d948 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.057287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.057955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.058245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.058729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.060130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.066992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.069803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 936/1894] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:32 2022] DELETE /identity/v3/users/c414fc88910748a4b795475f31e18db6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:33.074307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.074656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.074999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.097557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:33.098914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:33.169460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 937/1895] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:33.170739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.172406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:33.188428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f494265-9aa8-41fc-a13a-504eb4252bd2 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.193435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.194215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.194634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.194921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] PATH_INFO: `/v3/projects/f729b6a05a494864b886e1081068e6df` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.196441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f729b6a05a494864b886e1081068e6df)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.198437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.205284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 959/1896] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:33 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:33.206054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.209377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:33.285160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13f5cb-6aba-4ff0-bd35-5c0e7b6d098e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.288919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.289558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.289836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.290128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.357877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.359847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.372905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 960/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:33.373776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.383792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd4e8-4913-442a-b4e2-6ef8d78491f6 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.384774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f729b6a05a494864b886e1081068e6df', 'request_id': 'req-58d0ef31-4e9a-4169-bbf4-a482f1159365'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:33.393746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f729b6a05a494864b886e1081068e6df', 'request_id': 'req-58d0ef31-4e9a-4169-bbf4-a482f1159365'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:33.402328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:33.456281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.457181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.457461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.457732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.458640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.468494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.641312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f729b6a05a494864b886e1081068e6df', 'request_id': 'req-58d0ef31-4e9a-4169-bbf4-a482f1159365'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:33.648167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 961/1898] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:33 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:33.652280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.660764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] The token cache is being invalidate because project f729b6a05a494864b886e1081068e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:33.661327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:33.662763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:33.664891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 938/1899] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:33 2022] DELETE /identity/v3/projects/f729b6a05a494864b886e1081068e6df => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:33.666407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4378612-9dd8-419f-9e2c-a004ed5b4831 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.668758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.671501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:33.674357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.675940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.676377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.678126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.679708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.681709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.697827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0ef31-4e9a-4169-bbf4-a482f1159365 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.697827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.698658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.698948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.699308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] PATH_INFO: `/v3/users/d1d0be617e57433ea3b6973d00d05a90` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.701200 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d0be617e57433ea3b6973d00d05a90)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.703818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.730590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 962/1900] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:33.752075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.755058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:33.791946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31874908-cac7-4257-8d2e-796751df4dcc admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.800181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.800943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.801400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.801860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.802566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.804392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.818337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 963/1901] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:33.822043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:33.835004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cf19b-a989-4da5-9302-3b160289d57e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:33.842135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:33.842929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.851813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.851813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] PATH_INFO: `/v3/projects/679a2c6b4a1e40c193c2561387502c37/users/43a7e114246a421786d4dbaee3f9057c/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:33.860067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=679a2c6b4a1e40c193c2561387502c37, user_id=43a7e114246a421786d4dbaee3f9057c, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:33.863122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfae3e-8d1f-42c6-b09f-f81d40413cad admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:33.979154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 964/1902] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:33 2022] PUT /identity/v3/projects/679a2c6b4a1e40c193c2561387502c37/users/43a7e114246a421786d4dbaee3f9057c/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:33.991341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:33.991632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:33.991911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:34.027515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] MFA Rules not processed for user `43a7e114246a421786d4dbaee3f9057c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:34.029321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:34.030904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d0be617e57433ea3b6973d00d05a90'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.031624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d0be617e57433ea3b6973d00d05a90'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.039749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d0be617e57433ea3b6973d00d05a90'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.041268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d0be617e57433ea3b6973d00d05a90'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.058605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d0be617e57433ea3b6973d00d05a90'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.101336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 965/1903] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:34.102541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:34.103900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:34.179310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e44b6-2ca7-445d-9bc5-0e4370dc904a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:34.187277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:34.188516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:34.188516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:34.188516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] PATH_INFO: `/v3/projects/81a35112e92a4273937dd7a4a44efb59` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:34.189788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a35112e92a4273937dd7a4a44efb59)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:34.191762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:34.208567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 939/1904] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:33 2022] DELETE /identity/v3/users/d1d0be617e57433ea3b6973d00d05a90 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:34.209471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:34.211464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:34.292444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d4db5-3dc2-470f-8b31-7e6a7495d3a6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:34.297115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:34.297750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:34.298030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:34.298305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:34.374376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:34.376108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:34.387376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 940/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:34.393436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a35112e92a4273937dd7a4a44efb59', 'request_id': 'req-63e1c2f4-6606-4b63-927d-5b1979ab04b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.400316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a35112e92a4273937dd7a4a44efb59', 'request_id': 'req-63e1c2f4-6606-4b63-927d-5b1979ab04b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.550500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a35112e92a4273937dd7a4a44efb59', 'request_id': 'req-63e1c2f4-6606-4b63-927d-5b1979ab04b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.576259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] The token cache is being invalidate because project 81a35112e92a4273937dd7a4a44efb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:34.576906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.577763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:34.580518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 966/1906] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:34 2022] DELETE /identity/v3/projects/81a35112e92a4273937dd7a4a44efb59 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:34.590621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:34.679103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134fc5-2e2a-4bcd-88c6-95f13bddbaa8 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:34.783795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:34.785540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:34.785901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:34.786236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] PATH_INFO: `/v3/users/26d9c78e7ca344fd97f1b8c8f9f8ce44` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:34.788223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d9c78e7ca344fd97f1b8c8f9f8ce44)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:34.791259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:35.011589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:35.066871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:35.074114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:35.076233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d9c78e7ca344fd97f1b8c8f9f8ce44'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.077049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d9c78e7ca344fd97f1b8c8f9f8ce44'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.085836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d9c78e7ca344fd97f1b8c8f9f8ce44'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.086631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d9c78e7ca344fd97f1b8c8f9f8ce44'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.098004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c2f4-6606-4b63-927d-5b1979ab04b5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:35.102929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dd1ed56-907c-4763-b4d6-b882c28918f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d9c78e7ca344fd97f1b8c8f9f8ce44'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.107646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:35.108487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:35.109099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:35.109676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] PATH_INFO: `/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:35.111062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9e0dfc72f54e42a814e8f5d325f256)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:35.113154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:35.199501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 941/1907] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:34 2022] DELETE /identity/v3/users/26d9c78e7ca344fd97f1b8c8f9f8ce44 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:35.258572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9e0dfc72f54e42a814e8f5d325f256', 'request_id': 'req-e23b1ea0-3d26-4601-8623-955cabdcffcc'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.266391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9e0dfc72f54e42a814e8f5d325f256', 'request_id': 'req-e23b1ea0-3d26-4601-8623-955cabdcffcc'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.389091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9e0dfc72f54e42a814e8f5d325f256', 'request_id': 'req-e23b1ea0-3d26-4601-8623-955cabdcffcc'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.426091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] The token cache is being invalidate because project ad9e0dfc72f54e42a814e8f5d325f256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:35.427201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.430362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e23b1ea0-3d26-4601-8623-955cabdcffcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:35.434032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 967/1908] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:35 2022] DELETE /identity/v3/projects/ad9e0dfc72f54e42a814e8f5d325f256 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:35.460007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:35.460507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:35.460734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:35.506954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:35.508379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:35.692261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 942/1909] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:35.697424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:35.697831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:35.698212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:35.739030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:35.744931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:35.766849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 968/1910] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:35.771965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:35.787707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f809e63-43c4-41e3-acab-9425ade2b9a5 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:35.803150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:35.803861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:35.804194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:35.804458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:35.805682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:35.806594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:35.808352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:35.836349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 943/1911] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:35.842294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:35.857444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603dd0a-94fa-4daf-be36-78885494f085 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:35.868148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:35.870057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:35.870229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:35.871443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:35.874765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:35.883801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.074655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 969/1912] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:35 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:36.076866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.091662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8aef-143f-41aa-bf3c-755fc942a89e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.121656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.132119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:36.207333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.209658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.210023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.210312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.211093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.214203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.270152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22cef-15a7-4cc1-a41f-95c74110f061 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.276816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.277471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.277945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.278381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] PATH_INFO: `/v3/projects/0166edea6fd1451bb4c67083e5e308a9` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.279598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0166edea6fd1451bb4c67083e5e308a9)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.282624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.379460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 944/1913] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:36.383820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.397296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d496-cc62-4485-abf8-554a53496fae admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.403867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.404746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.405081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.405371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.406032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.407753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.426983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 945/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:36.429531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.449394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d1352-07ee-4005-9d51-f1bcd4158359 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.476360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0166edea6fd1451bb4c67083e5e308a9', 'request_id': 'req-58484a23-c4c4-4f6a-b267-4c39247ff40d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:36.487556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0166edea6fd1451bb4c67083e5e308a9', 'request_id': 'req-58484a23-c4c4-4f6a-b267-4c39247ff40d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:36.536799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.537421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.537694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.538139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.538787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.540461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.553778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 946/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:36.557343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.578983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7122bc-4726-47d4-ba9f-ce3c82c188b6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.590317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.591745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.592184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.592690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] PATH_INFO: `/v3/projects/b9a7e1569bb048cebb7eee815f6b108c/users/60a174687a9a4627a41975b5505e6172/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.612909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a7e1569bb048cebb7eee815f6b108c, user_id=60a174687a9a4627a41975b5505e6172, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.615771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437edc64-02db-4a89-91f0-415cc28aae01 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.635312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0166edea6fd1451bb4c67083e5e308a9', 'request_id': 'req-58484a23-c4c4-4f6a-b267-4c39247ff40d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:36.654654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] The token cache is being invalidate because project 0166edea6fd1451bb4c67083e5e308a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:36.655304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:36.655994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-58484a23-c4c4-4f6a-b267-4c39247ff40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:36.658851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 970/1916] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:36 2022] DELETE /identity/v3/projects/0166edea6fd1451bb4c67083e5e308a9 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:36.663400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b38-6985-4e9d-a376-aedd88e5441e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.664757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b38-6985-4e9d-a376-aedd88e5441e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.665374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b38-6985-4e9d-a376-aedd88e5441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.714866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b5ec5b38-6985-4e9d-a376-aedd88e5441e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:36.718452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b5ec5b38-6985-4e9d-a376-aedd88e5441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:36.719488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 947/1917] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:36 2022] PUT /identity/v3/projects/b9a7e1569bb048cebb7eee815f6b108c/users/60a174687a9a4627a41975b5505e6172/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:36.733199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.733665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.733780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.791599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] MFA Rules not processed for user `60a174687a9a4627a41975b5505e6172`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:36.793381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:36.858322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 971/1918] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:36.871684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.872641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.872908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.911049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:36.912841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:36.914413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 948/1919] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:36.918805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.922227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:36.927218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 972/1920] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:36.938467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438925-0f18-4fef-a0d9-242b702725de None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.939279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:36.944532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.945356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.945735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.946106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.947118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.949174 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.968358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6475b-9d84-4e70-a0bc-cc400ad49e7a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:36.973472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:36.974108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:36.974396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:36.974669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:36.975354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:36.975644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:36.977333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:36.990763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 973/1921] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:36.995070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.006478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699d59-e149-4008-a1ed-a0d3c9b8d86e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.011415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.012042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.012318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.012686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.013459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.015422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.113538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 949/1922] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:37.114813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.156106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 974/1923] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:36 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:37.157633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.229255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b292bc2-4474-42e9-aa27-bd992ae5593b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.275598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7af5-e324-4314-a9ce-4431b2be9808 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.282651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.284184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.284470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.284779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.286373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.289976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.305012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.305849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.306381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.306845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.308220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.310097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.425140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 975/1924] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:37 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:37.428825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.439388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037ddb-9846-4830-87f0-aa785af326b3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.444348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.445008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.445289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.445562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.446202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.447814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.464359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 950/1926] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:37 2022] POST /identity/v3/users => generated 288 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:37.466967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.480831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 976/1926] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:37.481330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55fd18-de6a-479a-9ee5-f90a4df8330a admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.481478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.484654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.484795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.486400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.486400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.486400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.492403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2dd7b-b9ff-4781-b9fc-4abd614a8484 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.498364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.498977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.499257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.499531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.500131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.500244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.501822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.513529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 977/1927] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:37.518176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.522084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 951/1928] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:37.527301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.529132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f21f32-9beb-4751-8fc5-e9004e930c2a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.538759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.538759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.538759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.538759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] PATH_INFO: `/v3/projects/239289b0a101407fa8f1935ae17327ba/users/e5904ab2b7f745faa2af95bc090d767c/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.539098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa87bb-e01d-4181-947f-03e860cc6bf9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.545184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.545854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.546165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.546394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] PATH_INFO: `/v3/projects/df19df3923634e169dec1cfbbd3a45eb/users/901582b21f414779ae41ea6861efb21f/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.561031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=239289b0a101407fa8f1935ae17327ba, user_id=e5904ab2b7f745faa2af95bc090d767c, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.564107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df19df3923634e169dec1cfbbd3a45eb, user_id=901582b21f414779ae41ea6861efb21f, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.564834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.566822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975b079-e31e-4bcf-b2bd-8ec28fb2ba07 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.708925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 978/1929] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:37 2022] PUT /identity/v3/projects/239289b0a101407fa8f1935ae17327ba/users/e5904ab2b7f745faa2af95bc090d767c/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:37.713303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.785820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:37.788279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 952/1930] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:37 2022] PUT /identity/v3/projects/df19df3923634e169dec1cfbbd3a45eb/users/901582b21f414779ae41ea6861efb21f/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:37.790085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec68c5a-547c-4c9e-8b11-3dd820dfbdea admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.799975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.800268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.800518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.830597 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] MFA Rules not processed for user `901582b21f414779ae41ea6861efb21f`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:37.831880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:37.865910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.866483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.866693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.866962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.867644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.869364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.880154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 979/1931] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:37.884113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.895025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88b6c-535e-4e29-b0ab-5f2051145c5e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:37.900753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:37.901424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.901705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.901983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] PATH_INFO: `/v3/projects/239289b0a101407fa8f1935ae17327ba/users/e5904ab2b7f745faa2af95bc090d767c/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.903982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] RBAC: Authorizing `identity:create_grant(project_id=239289b0a101407fa8f1935ae17327ba, user_id=e5904ab2b7f745faa2af95bc090d767c, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:37.907114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0408-61ea-4b9f-b15b-05f6118921db admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:37.911589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 953/1932] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:37.920503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 980/1933] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:37 2022] PUT /identity/v3/projects/239289b0a101407fa8f1935ae17327ba/users/e5904ab2b7f745faa2af95bc090d767c/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:37.923620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:37.925147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:37.931735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:37.932381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:37.932752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:37.977463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] MFA Rules not processed for user `e5904ab2b7f745faa2af95bc090d767c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:37.978724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:38.001496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e7cd-045b-48ec-be05-302dd5126025 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:38.055134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:38.055950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.056233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.056512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.061349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 981/1934] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:38.072947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:38.074650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:38.087586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e681-374a-4d4b-85be-5e6df81929b4 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:38.092869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:38.093483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.093812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.094209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.104964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:38.106521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:38.118271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 982/1935] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:38.125668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:38.127154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:38.137416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 954/1936] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:38.158800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:38.227735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ee93-c9e5-4b90-884c-2a6fdc7240bf service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:38.233059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:38.233837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.234125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.234399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] PATH_INFO: `/v3/users/901582b21f414779ae41ea6861efb21f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.235697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=901582b21f414779ae41ea6861efb21f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:38.237725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:38.392376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:38.401107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493e48-e2eb-4109-bb7b-ad7779b93657 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:38.405698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:38.406499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.406922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.407339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.454367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901582b21f414779ae41ea6861efb21f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:38.455181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901582b21f414779ae41ea6861efb21f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:38.462775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901582b21f414779ae41ea6861efb21f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:38.475669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:38.477241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901582b21f414779ae41ea6861efb21f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:38.477451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ae0bd-0b8a-4465-bfb4-31404c5b68e4 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:38.478325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901582b21f414779ae41ea6861efb21f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:38.487801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 955/1937] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:54:38.580197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 983/1938] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:38 2022] DELETE /identity/v3/users/901582b21f414779ae41ea6861efb21f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:38.585213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.585818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.585818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.605789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:38.607053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:38.666167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 956/1939] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:38.676130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:38.677567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:38.735643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44acd21-0d86-4ad9-a395-91bda219ed9b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:38.739424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:38.740035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:38.740315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:38.740610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:38.758354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:38.759822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24b70b-46a6-42f4-8acd-a6b5d059bb9d service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:38.770073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 984/1940] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:39.225127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:39.226593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:39.230256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:39.240431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfc2ec-ef9f-4e0c-8dbc-8cbec01a387b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:39.245189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:39.245827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.246101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.246371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] PATH_INFO: `/v3/projects/df19df3923634e169dec1cfbbd3a45eb` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.248203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=df19df3923634e169dec1cfbbd3a45eb)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:39.250145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:39.332947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df19df3923634e169dec1cfbbd3a45eb', 'request_id': 'req-b72bb2cb-dfff-4076-875c-a6669665e01b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:39.338733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df19df3923634e169dec1cfbbd3a45eb', 'request_id': 'req-b72bb2cb-dfff-4076-875c-a6669665e01b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:39.423645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df19df3923634e169dec1cfbbd3a45eb', 'request_id': 'req-b72bb2cb-dfff-4076-875c-a6669665e01b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:39.435994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] The token cache is being invalidate because project df19df3923634e169dec1cfbbd3a45eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:39.436420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:39.436971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b72bb2cb-dfff-4076-875c-a6669665e01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:39.438551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 957/1941] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:39 2022] DELETE /identity/v3/projects/df19df3923634e169dec1cfbbd3a45eb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:39.444227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.444508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.444811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.464807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:39.466011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:39.524607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 985/1942] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:39.532565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.532857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.533156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.554714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:39.555919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:39.564373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 958/1943] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:39.568670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:39.580363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8bb0c-5cd6-41f8-a437-f85f1264112a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:39.585596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:39.586391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.586680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.586951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.587599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:39.587899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:39.589552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:39.601435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:39.602235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 986/1944] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:39.606647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:39.624009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34f77-9006-4856-8c2a-65da4d43e3f9 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:39.630832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:39.631523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.631799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.632068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.632747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:39.636600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:39.786530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 959/1945] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:39 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:39.787928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:39.803539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae29f0b-a4a9-45f8-8bbb-33bcbdd65934 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:39.866888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:39.867659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:39.867947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:39.868222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:39.869066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:39.871148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:40.026398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 987/1946] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:39 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:40.027216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:40.041406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a1d86-ee3d-4d67-982e-343c1529654b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:40.046994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:40.047922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:40.048378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:40.048754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:40.049400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:40.051744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:40.062256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 960/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:40.066377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:40.077170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ece14-ae89-4fb8-b06c-51f6b49a6024 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:40.082303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:40.082969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:40.083514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:40.083874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:40.084430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:40.086109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788032c-4910-4e93-9386-08aa53493ffd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:40.098186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 988/1948] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:40.102469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:40.112762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d399-1e83-462f-8b2b-bc0e765a0932 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:40.117267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:40.117910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:40.118184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:40.118454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] PATH_INFO: `/v3/projects/f9b20975774c4f6bb00cde34670a024f/users/d68a2c9e0c484fa19a4cd66bd0efd79a/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:40.132757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b20975774c4f6bb00cde34670a024f, user_id=d68a2c9e0c484fa19a4cd66bd0efd79a, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:40.135379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:40.236079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 961/1949] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:40 2022] PUT /identity/v3/projects/f9b20975774c4f6bb00cde34670a024f/users/d68a2c9e0c484fa19a4cd66bd0efd79a/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:40.246528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:40.246848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:40.247123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:40.275435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] MFA Rules not processed for user `d68a2c9e0c484fa19a4cd66bd0efd79a`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:40.276775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:40.343332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 989/1950] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:40.355570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:40.358059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:40.437405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a93b3-8036-4fc9-ba47-be4bd8cfdb7c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:40.441026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:40.441628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:40.441903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:40.442176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:40.453037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:40.454479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4925931-2168-48b8-a111-15c9209f6ffb service glance] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:40.464703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 962/1951] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:40.868155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:41.722413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:42.587872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:42.767184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:43.011004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:43.012526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:43.080416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46eb06-2253-4093-8639-3e7c359296bd None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:43.085967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:43.086605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:43.086890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:43.087167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] PATH_INFO: `/v3/users/60a174687a9a4627a41975b5505e6172` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:43.088300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a174687a9a4627a41975b5505e6172)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:43.090560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:43.095871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:43.279314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a174687a9a4627a41975b5505e6172'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:43.280237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a174687a9a4627a41975b5505e6172'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:43.288000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a174687a9a4627a41975b5505e6172'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:43.304497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a174687a9a4627a41975b5505e6172'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:43.305550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a174687a9a4627a41975b5505e6172'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:43.794447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 990/1952] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:43 2022] DELETE /identity/v3/users/60a174687a9a4627a41975b5505e6172 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:43.799086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:43.799550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:43.799653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:43.823332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:43.824569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:43.898915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 963/1953] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:43.909339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:43.911079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:44.013725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162860-50fe-4278-bbbc-0c1e49fdb511 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:44.018922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:44.019681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:44.019966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:44.020239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:44.031072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:44.032545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:44.043428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 991/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:44.603775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:44.606472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:44.630166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7567ff-8ad9-4e53-9654-5cf67dc88587 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:44.635766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:44.636721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:44.637685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:44.638799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] PATH_INFO: `/v3/projects/b9a7e1569bb048cebb7eee815f6b108c` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:44.642236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a7e1569bb048cebb7eee815f6b108c)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:44.644340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:44.797277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:44.817518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a7e1569bb048cebb7eee815f6b108c', 'request_id': 'req-1c8890ec-d920-469a-b2bf-018958c1873b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:44.827573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a7e1569bb048cebb7eee815f6b108c', 'request_id': 'req-1c8890ec-d920-469a-b2bf-018958c1873b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:44.984193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a7e1569bb048cebb7eee815f6b108c', 'request_id': 'req-1c8890ec-d920-469a-b2bf-018958c1873b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:44.997592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] The token cache is being invalidate because project b9a7e1569bb048cebb7eee815f6b108c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:44.998326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:44.999101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.004614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 964/1955] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:44 2022] DELETE /identity/v3/projects/b9a7e1569bb048cebb7eee815f6b108c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:45.005112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:45.016647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93192d-6aed-43a3-81db-129025ef6807 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:45.084125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:45.084855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:45.085158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:45.085393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] PATH_INFO: `/v3/users/e5904ab2b7f745faa2af95bc090d767c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:45.087016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5904ab2b7f745faa2af95bc090d767c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:45.089360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:45.203159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:45.315562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5904ab2b7f745faa2af95bc090d767c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.316372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5904ab2b7f745faa2af95bc090d767c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.323242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5904ab2b7f745faa2af95bc090d767c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.339094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5904ab2b7f745faa2af95bc090d767c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.339925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2bca290f-b332-4656-b52a-f9cfe82c99ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5904ab2b7f745faa2af95bc090d767c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:45.441468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 992/1956] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:45 2022] DELETE /identity/v3/users/e5904ab2b7f745faa2af95bc090d767c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:45.992456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:45.993976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:46.011625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8890ec-d920-469a-b2bf-018958c1873b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.079250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.079891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.080219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.080494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] PATH_INFO: `/v3/projects/239289b0a101407fa8f1935ae17327ba` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.081641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239289b0a101407fa8f1935ae17327ba)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.083837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.236791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239289b0a101407fa8f1935ae17327ba', 'request_id': 'req-5991e353-279e-4f39-832b-6499e4da3899'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:46.245223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239289b0a101407fa8f1935ae17327ba', 'request_id': 'req-5991e353-279e-4f39-832b-6499e4da3899'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:46.327027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239289b0a101407fa8f1935ae17327ba', 'request_id': 'req-5991e353-279e-4f39-832b-6499e4da3899'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:46.339464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] The token cache is being invalidate because project 239289b0a101407fa8f1935ae17327ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:46.339779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:46.340487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5991e353-279e-4f39-832b-6499e4da3899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:46.342076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 965/1957] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:45 2022] DELETE /identity/v3/projects/239289b0a101407fa8f1935ae17327ba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:46.346938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.347401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.347505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.369390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:46.370797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:46.433808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 993/1958] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:46.442628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.442914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.443191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.443416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:46.464986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:46.466428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:46.475121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 966/1959] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:46.487246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:46.498789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027e72-37fe-4929-a492-79b669ea8223 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.506171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.506796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.507072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.507370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.508023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:46.508320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.510323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.523926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 994/1960] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:46.528254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:46.542030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948027d-496d-47d4-a949-8688a54b7fca None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.546171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.546790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.547274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.547379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.548058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.549998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.595335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:46.682880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 967/1961] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:46 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:46.696015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:46.697971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f5af-2cac-4f55-ba03-4c01257c026a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.759377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.759987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.760262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.760532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.761200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.763453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.919868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 995/1962] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:46 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:46.921050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:46.932847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a8cc2-93ac-4537-a913-0da9d7b4ee51 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.938437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.939056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.939334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.939606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.940431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.942088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.956188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 968/1963] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:46.957589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:46.969691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b4284-61f9-4d8b-843b-0894cde9247d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:46.974496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:46.975121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:46.978538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:46.978538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:46.978538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:46.978538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e296717-0372-48a5-aff1-5adcce08ccc6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:46.991272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 996/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:46.995262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.005836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab724-00ca-4ebc-a633-3e72399bef0f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.018682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.018682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.018682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.018682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] PATH_INFO: `/v3/projects/6f6bd6fed0234fc3b88b44b68025cce5/users/0c31c082f8414ee09c302e1a31acde3b/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.032355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6bd6fed0234fc3b88b44b68025cce5, user_id=0c31c082f8414ee09c302e1a31acde3b, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.035111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.130916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 969/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:46 2022] PUT /identity/v3/projects/6f6bd6fed0234fc3b88b44b68025cce5/users/0c31c082f8414ee09c302e1a31acde3b/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:47.142389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.142694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.142972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.173542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] MFA Rules not processed for user `0c31c082f8414ee09c302e1a31acde3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:47.174883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:47.244057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 997/1966] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:47.248620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.321073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba411-384c-4542-a72a-5fbe26128c12 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.326540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.327157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.327433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.327732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.328373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.330313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.453348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:47.464418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 970/1967] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:47 2022] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:47.469114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.479690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3def1e-2302-4785-9b4c-625734877a5c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.540963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.541585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.541842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.542108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.542733 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.544870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.645751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 998/1968] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:47 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:47.649746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.661638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0f789-b99a-43c9-a0a8-0ad9ff7a44d1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.666327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.666966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.667263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.667518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.668159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.669788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.680582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 971/1969] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:54:47.685972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.696270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522803-13a3-47a1-abf0-88f7c7908b6d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.701498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.702246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.702702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.702978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] PATH_INFO: `/v3/projects/26ac397343704143b8b8130a92fe93f0/users/9450f9812fe64c139428c85a627dd27d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.719840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ac397343704143b8b8130a92fe93f0, user_id=9450f9812fe64c139428c85a627dd27d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.722757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.811757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 999/1970] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:47 2022] PUT /identity/v3/projects/26ac397343704143b8b8130a92fe93f0/users/9450f9812fe64c139428c85a627dd27d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:47.815851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.817919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:47.827797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351120-e6f7-4c82-852a-d85bee39bbbf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.885949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.886569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.886878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.887367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.888030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.889657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353749-a6ef-46af-bfef-041b522c3d19 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.899479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 972/1971] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:47.904494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:47.914944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555669-4c42-413d-a945-818e7794a03d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:47.920785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:47.921437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.921716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.921988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] PATH_INFO: `/v3/projects/26ac397343704143b8b8130a92fe93f0/users/9450f9812fe64c139428c85a627dd27d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.923879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ac397343704143b8b8130a92fe93f0, user_id=9450f9812fe64c139428c85a627dd27d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:47.926590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:47.936962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1000/1972] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:47 2022] PUT /identity/v3/projects/26ac397343704143b8b8130a92fe93f0/users/9450f9812fe64c139428c85a627dd27d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:54:47.947975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:47.948262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:47.948540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:47.978081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] MFA Rules not processed for user `9450f9812fe64c139428c85a627dd27d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:47.979218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:48.050204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 973/1973] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:48.061687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:48.063473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:48.123216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:48.138958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222f50-325c-4cf9-8898-57065f0cf527 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:48.144555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:48.145242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:48.145523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:48.145824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:48.158169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:48.159669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:48.170850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1001/1974] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:48.261347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:48.272277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ae1f2-b4b4-4fde-845c-1204dbdf9b92 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:48.276219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:48.276867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:48.281175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:48.281175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:48.335687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:48.337171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac744d-ca29-4dc0-bf9c-d2887cd270d3 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:48.347559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 974/1975] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:49.838838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:50.018344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:50.854961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:50.857143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:50.947829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080fc8f-740a-47de-ae97-9050bdc2bde7 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:50.958834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:50.959445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:50.959725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:50.960026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] PATH_INFO: `/v3/users/43a7e114246a421786d4dbaee3f9057c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:50.961269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a7e114246a421786d4dbaee3f9057c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:50.963215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:51.191104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a7e114246a421786d4dbaee3f9057c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:51.191751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a7e114246a421786d4dbaee3f9057c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:51.198397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a7e114246a421786d4dbaee3f9057c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:51.211121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a7e114246a421786d4dbaee3f9057c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:51.211734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a7e114246a421786d4dbaee3f9057c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:51.309609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1002/1976] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:50 2022] DELETE /identity/v3/users/43a7e114246a421786d4dbaee3f9057c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:51.314056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:51.314550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:51.314656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:51.334896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:51.336108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:51.403558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 975/1977] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:51.413898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:51.415429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:51.480561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1a19-4ef1-4ca2-a694-e3a3bade9425 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:51.485947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:51.486884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:51.487306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:51.487630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:51.504026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:51.504026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357f87d-36ef-41ee-8d78-45ff7730a20c service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:51.514217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1003/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:51.997493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:51.999366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:52.010209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:52.033338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dc8c5-bb58-4e71-9031-53e7eccbff85 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:52.041351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:52.042358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.042643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.042922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] PATH_INFO: `/v3/projects/679a2c6b4a1e40c193c2561387502c37` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.045111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679a2c6b4a1e40c193c2561387502c37)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:52.048418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:52.242249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679a2c6b4a1e40c193c2561387502c37', 'request_id': 'req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:52.248135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679a2c6b4a1e40c193c2561387502c37', 'request_id': 'req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:52.356397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:52.389542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679a2c6b4a1e40c193c2561387502c37', 'request_id': 'req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:52.402373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] The token cache is being invalidate because project 679a2c6b4a1e40c193c2561387502c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:52.404344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:52.404344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-80f5f47d-6ab4-487e-83ff-b1686b5a5d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:52.406929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 976/1979] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:51 2022] DELETE /identity/v3/projects/679a2c6b4a1e40c193c2561387502c37 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:52.411823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.412105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.412378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.433906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:52.434903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:52.501509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1004/1980] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:54:52.508980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.509265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.509661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.530532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:52.532280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:52.541033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 977/1981] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:52.546327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:52.560133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088bed6-a19c-483c-a1d9-f49c3f036eae None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:52.565024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:52.567173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.567173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.567173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.567173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:52.567173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:52.569269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:52.581892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1005/1982] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:52.586494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:52.597415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54bde-9911-4de2-b3b3-b47876555784 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:52.602327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:52.607321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.607321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.607321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.607321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:52.607321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:52.739392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 978/1983] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:52 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:52.743763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:52.754461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c713d-f593-4e4e-9f63-46300cd7d04c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:52.826827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:52.827456 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.827828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.828125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.828839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:52.830766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:52.924642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1006/1984] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:52 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:52.927146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:52.941318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e966234-b753-469c-8615-6094371e3c46 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:52.957303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:52.958815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:52.959938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:52.959938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:52.960306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:52.962303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:52.986871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 979/1985] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:52.987526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:53.000031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fd86-7fca-498b-b2b3-1125693a8587 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:53.007973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:53.008649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:53.009000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:53.009376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:53.010099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:53.013160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ce7b5-c507-4e0a-b1d1-732dd7abdae8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:53.027420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1007/1986] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:53.031880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:53.046543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c55cdf-183d-46c2-aaa5-5a7f9c6f769f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:53.048399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:53.049178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:53.049458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:53.049735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] PATH_INFO: `/v3/projects/deb16b378091425fba4604f88254714c/users/8b6564cd81f046479fc8d0a4dc567b76/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:53.074959 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb16b378091425fba4604f88254714c, user_id=8b6564cd81f046479fc8d0a4dc567b76, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:53.077901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:53.207198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 980/1987] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:53 2022] PUT /identity/v3/projects/deb16b378091425fba4604f88254714c/users/8b6564cd81f046479fc8d0a4dc567b76/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:53.217867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:53.218136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:53.218410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:53.245802 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] MFA Rules not processed for user `8b6564cd81f046479fc8d0a4dc567b76`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:53.247552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:53.311380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1008/1988] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:53.323350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:53.325723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:53.386062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760a24-a46a-4d12-932a-dc62b968f4f6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:53.394696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:53.394696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:53.394696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:53.394696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:53.399565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:53.401031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be4e5a-0557-4990-b5db-d89c32e7580b service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:53.410293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 981/1989] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:53.492258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:53.881064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:54.008359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:54.009980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:54.154625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaad39-0240-425d-a17c-0a4db0f4c3af None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:54.159220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:54.159869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:54.160342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:54.160696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] PATH_INFO: `/v3/users/0c31c082f8414ee09c302e1a31acde3b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:54.164144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c31c082f8414ee09c302e1a31acde3b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:54.164144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:54.394203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c31c082f8414ee09c302e1a31acde3b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:54.394877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c31c082f8414ee09c302e1a31acde3b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:54.402234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c31c082f8414ee09c302e1a31acde3b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:54.414783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c31c082f8414ee09c302e1a31acde3b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:54.415561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c31c082f8414ee09c302e1a31acde3b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:54.508207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1009/1990] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:54 2022] DELETE /identity/v3/users/0c31c082f8414ee09c302e1a31acde3b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:54.510339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:54.510802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:54.510802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:54.529906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:54.531158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:54.594709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 982/1991] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:54.604615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:54.606469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:54.662890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e258ef9-1d38-4bda-96f0-9fbbf4f7c6a3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:54.666815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:54.667453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:54.667780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:54.668135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:54.677393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:54.680347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:54.689864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1010/1992] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:55.141422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:55.144394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:55.162005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102720a5-2adc-49c1-8a0c-820530e4b049 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:55.174536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:55.175185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:55.175457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:55.175721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] PATH_INFO: `/v3/projects/6f6bd6fed0234fc3b88b44b68025cce5` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:55.176878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6bd6fed0234fc3b88b44b68025cce5)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:55.178898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:55.296261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6bd6fed0234fc3b88b44b68025cce5', 'request_id': 'req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.302093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6bd6fed0234fc3b88b44b68025cce5', 'request_id': 'req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.376088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6bd6fed0234fc3b88b44b68025cce5', 'request_id': 'req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.389146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] The token cache is being invalidate because project 6f6bd6fed0234fc3b88b44b68025cce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:55.389520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.390234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.391746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 983/1993] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:55 2022] DELETE /identity/v3/projects/6f6bd6fed0234fc3b88b44b68025cce5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:55.395880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:55.405645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde6ec-2a70-47a7-8e17-3060e46963fa service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:55.477399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:55.478343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:55.478767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:55.479204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] PATH_INFO: `/v3/users/9450f9812fe64c139428c85a627dd27d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:55.481336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9450f9812fe64c139428c85a627dd27d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:55.483437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:55.544810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:55.681672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:55.706934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9450f9812fe64c139428c85a627dd27d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.708454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9450f9812fe64c139428c85a627dd27d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.717588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9450f9812fe64c139428c85a627dd27d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.737915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9450f9812fe64c139428c85a627dd27d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.738764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-df5a6023-f2f5-4898-a18d-853c424b0850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9450f9812fe64c139428c85a627dd27d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:55.924509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1011/1994] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:54:55 2022] DELETE /identity/v3/users/9450f9812fe64c139428c85a627dd27d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:56.406008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:56.407497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:56.421406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf2bcb-0bf1-4a5d-8fc8-9f1ac0f7af12 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:56.483589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:56.484155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:56.484432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:56.484738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] PATH_INFO: `/v3/projects/26ac397343704143b8b8130a92fe93f0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:56.486589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ac397343704143b8b8130a92fe93f0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:56.489647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:56.607248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ac397343704143b8b8130a92fe93f0', 'request_id': 'req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:56.613049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ac397343704143b8b8130a92fe93f0', 'request_id': 'req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:56.692055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ac397343704143b8b8130a92fe93f0', 'request_id': 'req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:56.704213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] The token cache is being invalidate because project 26ac397343704143b8b8130a92fe93f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:54:56.704365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:56.705028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dea7a47-459b-4cd9-8a1e-7a59dafcd6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:54:56.706537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 984/1995] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:54:56 2022] DELETE /identity/v3/projects/26ac397343704143b8b8130a92fe93f0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:56.711772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:56.712193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:56.712303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:56.733324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:56.734604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:56.799407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1012/1996] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:56.807231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:56.807515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:56.807792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:56.824246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:56.830378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:56.831708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:56.841207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 985/1997] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:56.845364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:56.851604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:56.857669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2a87c-66e9-4310-91ca-882f53ef0411 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:56.862605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:56.863289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:56.863634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:56.863909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:56.864560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:54:56.864894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:56.866516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:56.880008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1013/1998] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:54:56.884346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:56.894851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f890474-6994-4b9a-9b13-8a075649099e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:56.899761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:56.900468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:56.900852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:56.901130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:56.901870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:56.903876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:56.997410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 986/1999] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:56 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:57.001644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.012294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffa5c-fe2d-4309-9cb6-d5fc747a8717 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.069192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.069830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.070107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.070377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.071009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.072977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.195725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1014/2000] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:57 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:57.197335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:57.200190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.211030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ccd85-0c26-4278-ac3e-eac66397ba6b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.215761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.216353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.216733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.217006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.217669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.219247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.232645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 987/2001] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:57.235532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.246655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe90ce-eb07-4355-a3d0-0f8d160f9d5f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.252048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.252718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.252996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.255054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.255054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.255552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028083c-a88d-4f54-b6bc-0207bda16365 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.267391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1015/2002] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:57.276816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.282428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47099d-715a-45b0-8892-43bbb7f5fb61 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.286968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.287608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.287884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.288156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] PATH_INFO: `/v3/projects/bc4457a321b4439582bc93e45d6a26db/users/56b0371735f24953927658aac2c0ed27/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.304614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4457a321b4439582bc93e45d6a26db, user_id=56b0371735f24953927658aac2c0ed27, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.307240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.342790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:57.401026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 988/2003] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:57 2022] PUT /identity/v3/projects/bc4457a321b4439582bc93e45d6a26db/users/56b0371735f24953927658aac2c0ed27/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:57.411663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.411952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.412233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.442902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] MFA Rules not processed for user `56b0371735f24953927658aac2c0ed27`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:57.444134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:57.508728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1016/2004] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:57.513490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.576779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861a76-f232-47e8-b668-4ef6933a41ae admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.581877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.582476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.582755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.583278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.583931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.585896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.623794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:57.693447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 989/2005] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:54:57 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:54:57.698057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:57.699659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.711950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40620d88-fcbc-4528-81f6-73b20fb59e03 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.778672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.784005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.784879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.785053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.785723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.787668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.927273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1017/2006] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:54:57 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:54:57.931399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.941944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1012118-6202-442a-bc66-5c4b5f4931df admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.946489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.948492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.948492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.948492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.948492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:57.950798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:57.962204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 990/2007] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:57.967199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:57.977537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05269371-1275-47b4-aa7a-dc37e349cf58 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:57.982488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:57.983146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:57.983431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:57.983705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] PATH_INFO: `/v3/projects/4913aca1723243d0a120b79b51d550c6/users/b3b50916a1c844589fd8015dcb4a85a0/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:57.998764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4913aca1723243d0a120b79b51d550c6, user_id=b3b50916a1c844589fd8015dcb4a85a0, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:58.001482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:58.069612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1018/2008] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:57 2022] PUT /identity/v3/projects/4913aca1723243d0a120b79b51d550c6/users/b3b50916a1c844589fd8015dcb4a85a0/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:58.073696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:58.084160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f98c-348d-42fd-b80d-0227beee4784 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:58.144772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:58.145383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:58.145663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:58.145931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:58.146574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:58.148167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa3921-d218-4c53-bfd3-fc542577f10f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:58.158014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 991/2009] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:54:58.162161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:58.173057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d40b3-e8ff-4f9f-8940-15ef4c899137 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:58.177795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:58.178452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:58.178731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:58.179002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] PATH_INFO: `/v3/projects/4913aca1723243d0a120b79b51d550c6/users/b3b50916a1c844589fd8015dcb4a85a0/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:58.181015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4913aca1723243d0a120b79b51d550c6, user_id=b3b50916a1c844589fd8015dcb4a85a0, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:58.184491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:58.194654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1019/2010] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:54:58 2022] PUT /identity/v3/projects/4913aca1723243d0a120b79b51d550c6/users/b3b50916a1c844589fd8015dcb4a85a0/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:54:58.205878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:58.206166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:58.206467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:58.224654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.235279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] MFA Rules not processed for user `b3b50916a1c844589fd8015dcb4a85a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:54:58.236497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:58.275252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.309558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 992/2011] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:54:58.320663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:58.322595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:54:58.379814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a11ba3-64ac-4c41-9bf3-27da6ab29027 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:58.383396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:58.384023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:58.384300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:58.384601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:58.393415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:58.394844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:58.404935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1020/2012] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:58.467603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.490302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.511957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:54:58.521580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920d67-991e-4003-aa0d-9e0045050944 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:54:58.528985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:54:58.529863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:54:58.530283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:54:58.530566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:54:58.586823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:54:58.588219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cf0c1-ffa5-48bf-a5c2-3273460d65d4 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:54:58.597999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 993/2013] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:54:58.612827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.806839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:58.950393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:59.760983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:59.795142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:54:59.978321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:00.155652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:00.526438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:00.612111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:00.748432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.052186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.091795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.177805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.252452 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.330143 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.406445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.506207 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:01.612625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:09.337737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:09.399827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de01e7e-84f0-4793-95eb-bb04ffa03b03 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:09.405410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:09.406037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:09.406320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:09.406595 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] PATH_INFO: `/v3/users/56b0371735f24953927658aac2c0ed27` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:09.407725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b0371735f24953927658aac2c0ed27)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:09.409691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:09.645161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b0371735f24953927658aac2c0ed27'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:09.645818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b0371735f24953927658aac2c0ed27'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:09.653397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b0371735f24953927658aac2c0ed27'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:09.665599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b0371735f24953927658aac2c0ed27'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:09.666291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b0371735f24953927658aac2c0ed27'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:09.771882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1021/2014] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:09 2022] DELETE /identity/v3/users/56b0371735f24953927658aac2c0ed27 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:09.779121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:09.779584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:09.779907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:09.799696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:09.800950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:09.864903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 994/2015] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:09.875225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:09.876666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:09.933682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da8c39-18c2-46b6-acb0-c5e223d1c6b4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:09.937422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:09.938028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:09.938303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:09.938571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:09.953816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:09.953816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:09.962127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1022/2016] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:10.475871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:10.477367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:10.491159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4962ed1-818c-4bd6-a340-0e1a999a57ef None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:10.496144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:10.496824 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:10.497105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:10.497378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] PATH_INFO: `/v3/projects/bc4457a321b4439582bc93e45d6a26db` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:10.499220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4457a321b4439582bc93e45d6a26db)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:10.501187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:10.608125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:10.623891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4457a321b4439582bc93e45d6a26db', 'request_id': 'req-da82bed2-fcac-4d72-99e6-bc5378481a63'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:10.629153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4457a321b4439582bc93e45d6a26db', 'request_id': 'req-da82bed2-fcac-4d72-99e6-bc5378481a63'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:10.789057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4457a321b4439582bc93e45d6a26db', 'request_id': 'req-da82bed2-fcac-4d72-99e6-bc5378481a63'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:10.800932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] The token cache is being invalidate because project bc4457a321b4439582bc93e45d6a26db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:10.801219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:10.802035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:10.803552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 995/2017] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:10 2022] DELETE /identity/v3/projects/bc4457a321b4439582bc93e45d6a26db => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:10.807637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:10.817418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63398305-4847-4225-b4a7-9e50a5c33a96 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:10.822235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:10.874967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:10.875527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:10.875808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:10.876120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] PATH_INFO: `/v3/users/b3b50916a1c844589fd8015dcb4a85a0` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:10.877263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b50916a1c844589fd8015dcb4a85a0)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:10.879212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:11.160634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:11.162066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:11.174870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bed2-fcac-4d72-99e6-bc5378481a63 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:11.179548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:11.180192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:11.180473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:11.180847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] PATH_INFO: `/v3/users/e640198750cc4803b8d60969076fa313` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:11.181961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e640198750cc4803b8d60969076fa313)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:11.184789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:11.192286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b50916a1c844589fd8015dcb4a85a0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.192965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b50916a1c844589fd8015dcb4a85a0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.201723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b50916a1c844589fd8015dcb4a85a0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.213994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b50916a1c844589fd8015dcb4a85a0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.215350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5d05d2f3-5e8f-4082-a933-d0847b87c144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b50916a1c844589fd8015dcb4a85a0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.301090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1023/2018] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:10 2022] DELETE /identity/v3/users/b3b50916a1c844589fd8015dcb4a85a0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:11.367408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e640198750cc4803b8d60969076fa313'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.368062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e640198750cc4803b8d60969076fa313'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.376175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e640198750cc4803b8d60969076fa313'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.376835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e640198750cc4803b8d60969076fa313'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.390604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e640198750cc4803b8d60969076fa313'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.482049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 996/2019] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:11 2022] DELETE /identity/v3/users/e640198750cc4803b8d60969076fa313 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:11.487024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:11.487313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:11.487589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:11.507851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:11.512439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:11.579409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1024/2020] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:11.590157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:11.591586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:11.651787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75270727-6a65-40b4-a718-3fff2dcb788e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:11.655825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:11.656436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:11.661136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:11.661136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:11.666622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:11.668647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81d11-f973-41a3-8867-14c1a8e8dff8 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:11.678702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 997/2021] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:11.751536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:11.753045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:11.766023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab14a-4963-481b-8400-f58dfc1b8953 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:11.772492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:11.773453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:11.773730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:11.774160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] PATH_INFO: `/v3/projects/4913aca1723243d0a120b79b51d550c6` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:11.775822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4913aca1723243d0a120b79b51d550c6)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:11.778027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:11.803683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:11.890813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4913aca1723243d0a120b79b51d550c6', 'request_id': 'req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.896399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4913aca1723243d0a120b79b51d550c6', 'request_id': 'req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.971931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4913aca1723243d0a120b79b51d550c6', 'request_id': 'req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.987347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] The token cache is being invalidate because project 4913aca1723243d0a120b79b51d550c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:11.987347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.989219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-19d32346-2ba3-4b9c-aa4b-4b9d8fcf0e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:11.994972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1025/2022] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:11 2022] DELETE /identity/v3/projects/4913aca1723243d0a120b79b51d550c6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:11.997565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:11.998015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:11.998250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.023041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:12.023041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:12.048533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:12.087661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 998/2023] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:12.096736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.097408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.097895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.119631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:12.121980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:12.132092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1026/2024] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:12.137574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.151056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d9ffe-04e9-412d-89e1-293cab2aa22b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.157606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.157606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.157886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.158390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.159377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:12.159488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.161210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.202017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 999/2025] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:12.202234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.207968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc615cf7-84b8-4706-81a9-c957b526a7a1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.213226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.213945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.214345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.214571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.215200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.217186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.345358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.353171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:12.362492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62ba40-efe3-45a9-a20a-8955c3510ef5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.368318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.368996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.369273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.369544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] PATH_INFO: `/v3/projects/c51f6a9117e94664afe932683c6c0440` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.371381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51f6a9117e94664afe932683c6c0440)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.373355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.407433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1027/2026] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:12.430329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.491555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1d51-ef7a-455b-85e8-b1b05cc412a2 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.497358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.498265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.498265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.498518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.499137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.501090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.585128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51f6a9117e94664afe932683c6c0440', 'request_id': 'req-0dde6fa2-46a3-4ef0-97af-10154513b3b3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:12.591415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51f6a9117e94664afe932683c6c0440', 'request_id': 'req-0dde6fa2-46a3-4ef0-97af-10154513b3b3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:12.663869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1028/2027] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:12 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:12.668725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.678240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adeae9-44f5-428a-ad42-73c25583a14f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.707025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51f6a9117e94664afe932683c6c0440', 'request_id': 'req-0dde6fa2-46a3-4ef0-97af-10154513b3b3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:12.720527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] The token cache is being invalidate because project c51f6a9117e94664afe932683c6c0440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:12.720922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:12.721592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:12.723104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1000/2028] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:12 2022] DELETE /identity/v3/projects/c51f6a9117e94664afe932683c6c0440 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:12.727032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.728386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:12.736001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.736632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.736915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.737183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.737828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.740198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.750033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1029/2029] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:12.753996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.755677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:12.767918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56737f9-966d-4db1-aa72-79266bd807ff admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.772651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.773251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.773532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.773806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.774442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.776098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.787132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1030/2030] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:12.791182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:12.793461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde6fa2-46a3-4ef0-97af-10154513b3b3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.798224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.798855 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.799133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.799407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] PATH_INFO: `/v3/users/356ec922ce3746f89c57d677792bbe0d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.800545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] RBAC: Authorizing `identity:delete_user(user_id=356ec922ce3746f89c57d677792bbe0d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.801605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35803de-f5c0-408b-8c6a-c826ab5660e0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:12.802706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.806274 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:12.806903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.807184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.807457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] PATH_INFO: `/v3/projects/28857a7ffeac466dbf80e8d6d354c88e/users/c151a351cc894b1ea7785e433ed439ff/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.822921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28857a7ffeac466dbf80e8d6d354c88e, user_id=c151a351cc894b1ea7785e433ed439ff, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:12.825633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb9dd9-e3e0-4220-96ec-a9ecb878f8f4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:12.837974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:12.937925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1031/2031] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:12 2022] PUT /identity/v3/projects/28857a7ffeac466dbf80e8d6d354c88e/users/c151a351cc894b1ea7785e433ed439ff/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:12.950060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:12.950348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:12.950621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:12.981447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] MFA Rules not processed for user `c151a351cc894b1ea7785e433ed439ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:12.982640 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:13.045343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1032/2032] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:13.049592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:13.100981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356ec922ce3746f89c57d677792bbe0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:13.101910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356ec922ce3746f89c57d677792bbe0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:13.110408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356ec922ce3746f89c57d677792bbe0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:13.111117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356ec922ce3746f89c57d677792bbe0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:13.113169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd54704-ca5b-4f4a-a2c9-c0d2888ab4ff None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:13.117795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:13.118400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:13.118676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:13.118953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:13.119673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:13.121897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:13.126651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356ec922ce3746f89c57d677792bbe0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:13.240677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1001/2033] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:12 2022] DELETE /identity/v3/users/356ec922ce3746f89c57d677792bbe0d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:13.247132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1033/2034] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:13.247975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:13.250013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:13.341064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbebe0-59ed-47a1-a104-1edd27d6302f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:13.404256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:13.404935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:13.410376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:13.410376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:13.410376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:13.410376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:13.543644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1002/2035] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:13 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:13.546201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:13.561383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c82dd-6c2a-4422-adc2-6b8b8026a8ed admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:13.567208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:13.567912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:13.568262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:13.568649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:13.570149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:13.572123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:13.592373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:13.617917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1034/2036] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:13.619030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b842-daf0-47cd-8dbc-411c9499cc40 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:13.628579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:13.630134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:13.630134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:13.630134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] PATH_INFO: `/v3/projects/aba9800c7932409a919182f0ba7d7142/users/a1670387d61d4f6f9c071a87da65ce34/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:13.650190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba9800c7932409a919182f0ba7d7142, user_id=a1670387d61d4f6f9c071a87da65ce34, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:13.789811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:13.895958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:13.955099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:13.957514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:13.972397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1003/2037] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:13 2022] PUT /identity/v3/projects/aba9800c7932409a919182f0ba7d7142/users/a1670387d61d4f6f9c071a87da65ce34/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:13.973111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d0da-7154-4e8a-9790-ab6c16432983 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:13.973486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.044606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.045500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.045829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.046425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] PATH_INFO: `/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.048895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a0c-9eac-4398-86c4-3cd9033dbc66 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.049696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2334e9c0a54784b6cd454f78ee48c5)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.051768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.055779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.056506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.056819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.057097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.058400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.060012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.070371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1004/2038] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:14.074803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.085444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae373f4f-4ca8-41d5-9519-47ee7d7ba534 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.091063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.097851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.097851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.097851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] PATH_INFO: `/v3/projects/aba9800c7932409a919182f0ba7d7142/users/a1670387d61d4f6f9c071a87da65ce34/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.097851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba9800c7932409a919182f0ba7d7142, user_id=a1670387d61d4f6f9c071a87da65ce34, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.097851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc7ee2-59e9-47ae-bda8-11cace051129 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.108550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1005/2039] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:14 2022] PUT /identity/v3/projects/aba9800c7932409a919182f0ba7d7142/users/a1670387d61d4f6f9c071a87da65ce34/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:14.118955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.119241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.119512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.147975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] MFA Rules not processed for user `a1670387d61d4f6f9c071a87da65ce34`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:14.149415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:14.217827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1006/2040] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:14.358406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.360023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:14.362171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2334e9c0a54784b6cd454f78ee48c5', 'request_id': 'req-a6adf8c8-6741-4369-a7f8-b9567ff3d608'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:14.369791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2334e9c0a54784b6cd454f78ee48c5', 'request_id': 'req-a6adf8c8-6741-4369-a7f8-b9567ff3d608'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:14.419734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9d93-b5cb-4e10-a5d8-b245638d1572 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.453511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2334e9c0a54784b6cd454f78ee48c5', 'request_id': 'req-a6adf8c8-6741-4369-a7f8-b9567ff3d608'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:14.467106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] The token cache is being invalidate because project 3d2334e9c0a54784b6cd454f78ee48c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:14.467397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:14.468053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a6adf8c8-6741-4369-a7f8-b9567ff3d608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:14.469716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1035/2041] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:13 2022] DELETE /identity/v3/projects/3d2334e9c0a54784b6cd454f78ee48c5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:14.474801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.475335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.475448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.475688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.475915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.476029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.476219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.477814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:14.496368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:14.497694 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:14.541496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.543378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523e915-72fc-4dc7-83c5-6e655a0e5bce service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.554520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1007/2042] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:55:14.577980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:14.588763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1036/2043] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:14.590604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.590900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.591349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.617051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:14.619091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:14.632638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1008/2044] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:14.637380 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.652379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228e9a0-153c-43f4-83fc-3f6c61a8c675 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.657589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.660069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.660069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.660069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.660069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:14.662830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.662830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.684712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1037/2045] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:14.689057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.699788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5b278-c89d-492c-90ec-b86ba00c4bab None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.704840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.705450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.705726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.705992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.706625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.708796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:14.812980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1009/2046] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:14 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:14.814092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:14.824196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526d1c3-bd03-46e5-896b-44f959d57f85 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:14.890414 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:14.890944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:14.891219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:14.891488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:14.892323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:14.894447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.060887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1038/2047] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:14 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:15.062807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.073009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7202e6-0017-4216-ab69-e357f3b3820c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.078009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.078617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.078892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.079162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.079807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.081442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.093207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1010/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:15.105155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.115200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180fb75-c27f-4374-a5d6-cdb52eb68f90 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.121591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.121591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.121591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.121916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.122470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.124116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac31f48-5f84-4dd6-ae05-9b7c3845259d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.135190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1039/2049] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:15.145629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.156013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9189-19c8-4546-8358-ff67380149a9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.160645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.161306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.161587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.161857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] PATH_INFO: `/v3/projects/740be0bf536742008e425b4abc49c07e/users/9c1ec365f76d4189bd24b88234e8f38a/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.176865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740be0bf536742008e425b4abc49c07e, user_id=9c1ec365f76d4189bd24b88234e8f38a, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.179530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.350234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1011/2050] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:15 2022] PUT /identity/v3/projects/740be0bf536742008e425b4abc49c07e/users/9c1ec365f76d4189bd24b88234e8f38a/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:15.362552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.362870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.363104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.397277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] MFA Rules not processed for user `9c1ec365f76d4189bd24b88234e8f38a`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:15.397277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:15.468769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1040/2051] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:15.472188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.540649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f143-515c-462d-8777-9f742c2e2a12 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.546981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.547609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.547871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.548451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.548805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.550698 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.658344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:15.672980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1012/2052] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:15 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:15.677589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.695832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6343-5a2f-445b-aa48-acd7acd4c9f1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.779349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.780078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.780361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.780678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.781332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.783343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.916471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1041/2053] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:15 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:15.920869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.936016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:15.961215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70db6-26ec-4ce4-a47c-4235d4cd5443 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:15.968114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:15.968926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:15.969138 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:15.969433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:15.970165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:15.971805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:15.983194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1013/2054] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:15.987377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:15.998317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c369d5-45b9-43f8-9494-ca86d3526e51 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:16.003285 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:16.004046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:16.004415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:16.005000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] PATH_INFO: `/v3/projects/03acff8b22f94737bd556e9f8c7c9138/users/7a616f5828e247c998f349af97a5c9b1/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:16.022732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03acff8b22f94737bd556e9f8c7c9138, user_id=7a616f5828e247c998f349af97a5c9b1, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:16.025476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:16.143873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1042/2055] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:15 2022] PUT /identity/v3/projects/03acff8b22f94737bd556e9f8c7c9138/users/7a616f5828e247c998f349af97a5c9b1/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:16.148276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:16.161343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bb206-6378-4854-a3ca-85b5d517935d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:16.238630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:16.239381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:16.239738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:16.240014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:16.240694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:16.242479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71346d7f-bfb1-4a06-9c76-3ca4db0027b3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:16.255038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1014/2056] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:16.259305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:16.271051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5575-1c8f-4c3d-862a-86eea902ca68 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:16.280570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:16.281265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:16.281721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:16.282147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] PATH_INFO: `/v3/projects/03acff8b22f94737bd556e9f8c7c9138/users/7a616f5828e247c998f349af97a5c9b1/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:16.284276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03acff8b22f94737bd556e9f8c7c9138, user_id=7a616f5828e247c998f349af97a5c9b1, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:16.287123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:16.298241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1043/2057] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:16 2022] PUT /identity/v3/projects/03acff8b22f94737bd556e9f8c7c9138/users/7a616f5828e247c998f349af97a5c9b1/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:16.309240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfb9e-0817-429a-9f2c-62e8ef922f63 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:16.309614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfb9e-0817-429a-9f2c-62e8ef922f63 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:16.309953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfb9e-0817-429a-9f2c-62e8ef922f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:16.341554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7e4dfb9e-0817-429a-9f2c-62e8ef922f63 None None] MFA Rules not processed for user `7a616f5828e247c998f349af97a5c9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:16.342738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7e4dfb9e-0817-429a-9f2c-62e8ef922f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:16.413375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1015/2058] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:16.424892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:16.426861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:16.490909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef20-be2c-4496-9a71-de4e1177ee1a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:16.495938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:16.496658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:16.497022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:16.497478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:16.563982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:16.563982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c866-7411-4793-a1d0-b6816c4cc6a0 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:16.570242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1044/2059] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:17.578036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:17.775482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:18.454794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:19.040455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:19.041056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:19.041056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:19.044386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1016/2060] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:55:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:55:19.079928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:19.080449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:19.080449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:19.101686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] MFA Rules not processed for user `3358589f4e9649beb8bffdf51844b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:19.102899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:19.165282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1045/2061] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:19.177518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:19.180152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:19.196035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:19.197413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:19.199410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169c5ad-25da-4a05-b53f-781ae1a3ee48 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:19.205080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:19.205777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:19.206134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:19.206957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:19.217247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:19.218922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:19.229918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1017/2062] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:19.277840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b2aa-e517-4fff-aa38-ef8d3c73c90d None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:19.278362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:19.279001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:19.279281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:19.279555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] PATH_INFO: `/v3/users/efec83d35c3c4045ba9fd603c54b1449` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:19.280745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=efec83d35c3c4045ba9fd603c54b1449)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:19.283159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:19.288546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:19.471161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efec83d35c3c4045ba9fd603c54b1449'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:19.471824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efec83d35c3c4045ba9fd603c54b1449'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:19.478844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efec83d35c3c4045ba9fd603c54b1449'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:19.492540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efec83d35c3c4045ba9fd603c54b1449'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:19.493259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-777df91c-d36d-40e3-a316-06b5cba7cc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efec83d35c3c4045ba9fd603c54b1449'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:19.595293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1046/2063] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:19 2022] DELETE /identity/v3/users/efec83d35c3c4045ba9fd603c54b1449 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:19.859271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:19.870819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c3454-695d-468d-823e-f1a62a3b872b service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:19.927878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:19.928507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:19.928816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:19.929091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] PATH_INFO: `/v3/projects/81483a6316a344a28c9b8184ab252446` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:19.930205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81483a6316a344a28c9b8184ab252446)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:19.932098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.146146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:20.159978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81483a6316a344a28c9b8184ab252446', 'request_id': 'req-e4d11829-445a-47de-8370-8ab55ea422d4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:20.165453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81483a6316a344a28c9b8184ab252446', 'request_id': 'req-e4d11829-445a-47de-8370-8ab55ea422d4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:20.278280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81483a6316a344a28c9b8184ab252446', 'request_id': 'req-e4d11829-445a-47de-8370-8ab55ea422d4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:20.291352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] The token cache is being invalidate because project 81483a6316a344a28c9b8184ab252446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:20.292444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:20.293373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e4d11829-445a-47de-8370-8ab55ea422d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:20.295105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1018/2064] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:19 2022] DELETE /identity/v3/projects/81483a6316a344a28c9b8184ab252446 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:20.302591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.303085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.303170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.322908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:20.324508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:20.390768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1047/2065] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:20.398715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.398930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.399205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.421630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:20.422876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:20.431897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1019/2066] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:20.436381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.451532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ec7d-821a-4f1c-ad06-82b7b41b7cc5 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.456618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.457308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.457590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.457858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.458778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:20.459090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.460739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.477300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1048/2067] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:20.478219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.488260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e992c5-5518-4516-89eb-24a50a66cf89 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.493109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.493714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.493989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.499549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.499549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.499549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.590766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1020/2068] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:20 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:20.594794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.605615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa076bba-931d-4eda-a7df-535b441950e5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.667570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.668192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.668469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.668771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.669418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.671405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.779857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1049/2069] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:20 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:20.781165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.791718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e41fc8-9de4-4a27-9407-94423d081b9b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.797049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.797871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.798586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.798586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.799032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.800921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.815111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1021/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:20.818932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.826464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:20.832238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b58017-9ebc-435d-aa63-8938834a3609 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.837286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.837920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.838195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.838459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.839480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.841092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7de9d-f6c8-4a3f-9129-c2c98f85ab7e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.851636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1050/2071] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:20.856045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:20.866489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ecb67-b14a-4447-b1f7-baf1cbb66e3c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:20.872293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:20.872973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.873249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.873536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] PATH_INFO: `/v3/projects/c13f58b6b73346e6b3d247a49eb7c6bf/users/e0c8f5c877f64de2a2f776c770aabfbd/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:20.888656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f58b6b73346e6b3d247a49eb7c6bf, user_id=e0c8f5c877f64de2a2f776c770aabfbd, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:20.891392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:20.982247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1022/2072] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:20 2022] PUT /identity/v3/projects/c13f58b6b73346e6b3d247a49eb7c6bf/users/e0c8f5c877f64de2a2f776c770aabfbd/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:20.993044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:20.993413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:20.993781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:21.022114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] MFA Rules not processed for user `e0c8f5c877f64de2a2f776c770aabfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:21.023318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:21.088106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1051/2073] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:21.102441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:21.104407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:21.199814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e7bec-f244-4d89-93ef-d2ec030ec5e2 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:21.206828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:21.206828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:21.206828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:21.207370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:21.216270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:21.217873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a6aac-4ade-469c-8d05-6ce1e30d6ca3 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:21.226934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1023/2074] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:21.481403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:21.543941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70fe1-f74c-4dc8-8d19-dbd1202f1342 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:21.548435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:21.549164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:21.549441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:21.549711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] PATH_INFO: `/v3/users/e0c8f5c877f64de2a2f776c770aabfbd` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:21.550848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c8f5c877f64de2a2f776c770aabfbd)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:21.553042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:21.792789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c8f5c877f64de2a2f776c770aabfbd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:21.793478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c8f5c877f64de2a2f776c770aabfbd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:21.800293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c8f5c877f64de2a2f776c770aabfbd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:21.813544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c8f5c877f64de2a2f776c770aabfbd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:21.814229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c8f5c877f64de2a2f776c770aabfbd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:21.919758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:21.924514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1052/2075] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:21 2022] DELETE /identity/v3/users/e0c8f5c877f64de2a2f776c770aabfbd => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:21.930802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:21.931088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:21.931365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:21.951810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:21.953243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.000283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:22.028099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1024/2076] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:22.038650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:22.040204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.098475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92379c4-5765-4e54-a060-0b45b8d56bfc admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:22.102173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:22.102843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.103117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.103384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.112546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:22.114006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:22.123513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1053/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:22.194033 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:22.195487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.208915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7c704-72e1-4199-897c-d6d89cfa9bdd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:22.214597 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:22.215350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.215729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.216100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] PATH_INFO: `/v3/users/8b6564cd81f046479fc8d0a4dc567b76` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.217481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6564cd81f046479fc8d0a4dc567b76)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:22.222426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:22.483250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6564cd81f046479fc8d0a4dc567b76'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.483905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6564cd81f046479fc8d0a4dc567b76'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.490743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6564cd81f046479fc8d0a4dc567b76'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.491363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6564cd81f046479fc8d0a4dc567b76'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.503363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-798bdb0f-5623-4cd0-9d99-8bfbb2d014c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6564cd81f046479fc8d0a4dc567b76'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.660488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1025/2078] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:22 2022] DELETE /identity/v3/users/8b6564cd81f046479fc8d0a4dc567b76 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:22.661261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:22.661630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.663680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.664102 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.664536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.675689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef597-4255-4b68-a627-a18f0a9c428a service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:22.689380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:22.690871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.736028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:22.737005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.737005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.737272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] PATH_INFO: `/v3/projects/c13f58b6b73346e6b3d247a49eb7c6bf` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.738482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13f58b6b73346e6b3d247a49eb7c6bf)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:22.740519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:22.754907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1026/2079] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:22.765507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:22.767065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:22.826232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb0aad-361d-46f5-9c1e-5340125b448b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:22.830005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:22.830622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.830899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.831172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.842110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:22.846492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:22.847697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb113f2-0efe-4c85-be39-8775336e87fd service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:22.858194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13f58b6b73346e6b3d247a49eb7c6bf', 'request_id': 'req-8b84fcd5-8df2-41ed-82ae-c028a9443999'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.859356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1027/2080] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:55:22.864576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13f58b6b73346e6b3d247a49eb7c6bf', 'request_id': 'req-8b84fcd5-8df2-41ed-82ae-c028a9443999'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.943021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13f58b6b73346e6b3d247a49eb7c6bf', 'request_id': 'req-8b84fcd5-8df2-41ed-82ae-c028a9443999'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.956424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] The token cache is being invalidate because project c13f58b6b73346e6b3d247a49eb7c6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:22.956886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.957608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b84fcd5-8df2-41ed-82ae-c028a9443999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:22.960024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1054/2081] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:22 2022] DELETE /identity/v3/projects/c13f58b6b73346e6b3d247a49eb7c6bf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:22.965366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:22.965763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:22.966132 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:22.987382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:22.988636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.049891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1028/2082] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:23.058633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.059146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.059493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.080080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:23.081327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.090110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1055/2083] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:23.094397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.105093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9098ac-2d7b-42ae-919e-f2391a88d66a None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.112713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.113334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.113612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.114354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.115020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:23.116075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.117920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.131045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1029/2084] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:55:23.135604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.144992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fca2ad-a701-4f2f-93f7-6475e7cd8d81 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.149854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.150457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.150848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.151730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.152632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.154415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.276799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1056/2085] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:23.280773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.290704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025e11-0197-433e-85dd-5f1830075586 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.310432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.312499 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.319191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:23.356283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.356920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.357193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.357457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.358314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.360244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.384315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4dcc-290d-4eeb-84be-b3ba3e9e9047 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.389120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.389752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.390030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.390306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] PATH_INFO: `/v3/projects/deb16b378091425fba4604f88254714c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.391469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb16b378091425fba4604f88254714c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.393425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.461603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1030/2086] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:23.466400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.475931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996f986-d07f-4bb7-a2e7-ffb430f5f4b1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.480647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.481234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.481512 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.481784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.482430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.484124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.494924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1031/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:23.499019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.506087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb16b378091425fba4604f88254714c', 'request_id': 'req-862626e8-d0e7-4a00-a17e-6c947c28e55b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:23.508423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e869f64-1714-41b5-973b-782a0eaa8467 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.512008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb16b378091425fba4604f88254714c', 'request_id': 'req-862626e8-d0e7-4a00-a17e-6c947c28e55b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:23.565235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.565875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.566156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.566449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.567088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.568781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.570924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:23.579749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1032/2088] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:23.582744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb16b378091425fba4604f88254714c', 'request_id': 'req-862626e8-d0e7-4a00-a17e-6c947c28e55b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:23.594665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] The token cache is being invalidate because project deb16b378091425fba4604f88254714c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:23.594953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:23.595077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.595732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-862626e8-d0e7-4a00-a17e-6c947c28e55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:23.597484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1057/2089] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:23 2022] DELETE /identity/v3/projects/deb16b378091425fba4604f88254714c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:23.602823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031594-f7b1-4a99-b04e-919aef34aad6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.603110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031594-f7b1-4a99-b04e-919aef34aad6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.603387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031594-f7b1-4a99-b04e-919aef34aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.606447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855e6df-d894-4eea-935c-5adcc3e983e6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.611263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.611903 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.612181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.612451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] PATH_INFO: `/v3/projects/b74cbe0b8d7a4b6dbb6d8096caa3ef89/users/da3082c6a8ae405d8ba4ed39cde48ee7/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.625126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4d031594-f7b1-4a99-b04e-919aef34aad6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:23.626343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4d031594-f7b1-4a99-b04e-919aef34aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.627623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74cbe0b8d7a4b6dbb6d8096caa3ef89, user_id=da3082c6a8ae405d8ba4ed39cde48ee7, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.630370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27356ec-eace-474f-a143-882ea7ed837d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.634721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1058/2090] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:23.642304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.642607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.642920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.661679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:23.662967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.671363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1059/2091] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:23.675306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.684832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2f01-5013-4012-a64b-d2c2163a3c62 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.689378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.689938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.690212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.690480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.691106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:23.691400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.693037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.704238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1060/2092] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:55:23.708416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.718029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4befe52-f5f8-495a-9d29-670da0037331 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.722496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:23.723065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.723340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.723607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.724248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:23.726248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:23.780548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1033/2093] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:23 2022] PUT /identity/v3/projects/b74cbe0b8d7a4b6dbb6d8096caa3ef89/users/da3082c6a8ae405d8ba4ed39cde48ee7/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:23.790798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:23.791076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:23.791347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:23.819366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] MFA Rules not processed for user `da3082c6a8ae405d8ba4ed39cde48ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:23.821228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.884579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1034/2094] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:23.895677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.897021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:23.904867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1061/2095] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:23.916907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:23.962333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56154e9-8455-4ff8-90a9-d97988eef810 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.979590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:23.994588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062343f4-3157-4947-b09a-5b3b819225b4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:23.999852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.000463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.000776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.001047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.001676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.003647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.033400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.034099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.034446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.034783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.077864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:24.103127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.104662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.113798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1035/2096] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:55:24.301908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1062/2097] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:23 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:24.306861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:24.318493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897be2-b6fe-4036-a669-62239d94ca5b service glance] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:24.323237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.323929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.324231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.324483 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.325191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.326862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.340085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1036/2098] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:24.341538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:24.351622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bdb6d-eda3-4ccd-9cc5-e84d3e40c171 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:24.357197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.357796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.358075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.358345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.358987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.360635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f079-eaac-41ea-96bb-8be9f6986121 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.372120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1063/2099] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:24.376036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:24.386265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab374d-63ac-406d-aa3b-0038be272d9f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:24.391146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.391799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.392079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.392350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] PATH_INFO: `/v3/projects/18d48205d9c9429b8824e235d3bd2565/users/406440356a1544f0920b59616e774d75/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.406710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d48205d9c9429b8824e235d3bd2565, user_id=406440356a1544f0920b59616e774d75, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.409400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.584780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1037/2100] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:24 2022] PUT /identity/v3/projects/18d48205d9c9429b8824e235d3bd2565/users/406440356a1544f0920b59616e774d75/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:24.591738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.591931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.592281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.612970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:24.614179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:24.672858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1064/2101] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:24.682576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:24.684310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:24.741353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813a10-7d77-48dd-b11f-46b65d0b5920 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:24.745002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:24.745694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:24.745969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:24.746239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:24.754979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:24.756403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:24.766043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1038/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:25.501918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:25.503588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:25.578279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd3cc-7bff-4e31-aa30-3df6c5b4e486 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:25.582891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:25.583965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:25.584389 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:25.585103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:25.587110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:25.657704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:25.659234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:25.670210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1065/2103] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:26.253141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:26.254705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:26.267777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb500c-0763-43ab-93f1-1227861af012 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:26.271411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:26.272010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:26.272280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:26.272546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:26.274422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:26.349639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:26.351089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a41f2-37f1-4d3f-a147-5839db990f63 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:26.362199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1039/2104] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:31.005999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:31.008023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:31.030424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01089d1-a00e-4df7-8ece-7bfbe1c23124 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:31.038819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:31.039687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:31.040168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:31.040699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] PATH_INFO: `/v3/users/d68a2c9e0c484fa19a4cd66bd0efd79a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:31.042489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68a2c9e0c484fa19a4cd66bd0efd79a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:31.045356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:31.061223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:31.341844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:31.342330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:31.342407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:31.399114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] MFA Rules not processed for user `406440356a1544f0920b59616e774d75`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:31.400549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:31.440401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:31.500574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1040/2105] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:31.501690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:31.515943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206ccf8-2763-4e38-86ee-ff14b532a675 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:31.523983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:31.524916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:31.525205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:31.525484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:31.527189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:31.529763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:31.554336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68a2c9e0c484fa19a4cd66bd0efd79a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:31.555926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68a2c9e0c484fa19a4cd66bd0efd79a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:31.588390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68a2c9e0c484fa19a4cd66bd0efd79a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:31.615464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68a2c9e0c484fa19a4cd66bd0efd79a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:31.616220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-dfea5fdc-1b76-4094-bb01-238bb72e6521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68a2c9e0c484fa19a4cd66bd0efd79a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:31.768271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1066/2106] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:31 2022] DELETE /identity/v3/users/d68a2c9e0c484fa19a4cd66bd0efd79a => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:31.772831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:31.773478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:31.774107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:31.783427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1041/2107] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:31 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:31.787189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:31.790431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:31.814906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:31.816828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:31.891289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0bff-5f3f-47b2-ada4-2589b5b77fba admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:31.898622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1067/2108] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:31.912941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:31.913882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:31.914354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:31.916010 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:31.917635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:31.918489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:31.920378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:31.922669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.007190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960599d-231b-46bb-b160-33cd07e072a5 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.011248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.011874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.012210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.012726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.023023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.024940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.036162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1068/2109] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:55:32.069611 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1042/2110] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:31 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:32.073552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:32.086431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8af9e-31b1-4e56-b768-4fcd2ebcd879 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.092115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.092794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.093070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.093348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.097193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.097193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.107431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1069/2111] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:32.111806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:32.122939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9de96-02b8-4f09-8fc8-9aa39db57f5d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.131806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.132519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.132851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.133127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] PATH_INFO: `/v3/projects/c3f8c835a04f40f28831f291f0a5fb27/users/5894f5698bd04431ae99eb287eb4cf4e/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.161634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8c835a04f40f28831f291f0a5fb27, user_id=5894f5698bd04431ae99eb287eb4cf4e, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.164723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.328670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1043/2112] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:32 2022] PUT /identity/v3/projects/c3f8c835a04f40f28831f291f0a5fb27/users/5894f5698bd04431ae99eb287eb4cf4e/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:32.332934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:32.345471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff1f3-0a33-4f3a-b310-2d8496c76b03 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.377755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:32.434535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.435396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.435819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.436094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.437420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.439619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.460124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1070/2113] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:32.464985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:32.478055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52166-3731-4282-8223-84b1ca22a32d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.484349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.487288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.487288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.487451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] PATH_INFO: `/v3/projects/c3f8c835a04f40f28831f291f0a5fb27/users/5894f5698bd04431ae99eb287eb4cf4e/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.489348 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8c835a04f40f28831f291f0a5fb27, user_id=5894f5698bd04431ae99eb287eb4cf4e, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.491980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68248e42-343b-428a-a91e-4cc869ae5db3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.502942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1044/2114] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:32 2022] PUT /identity/v3/projects/c3f8c835a04f40f28831f291f0a5fb27/users/5894f5698bd04431ae99eb287eb4cf4e/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:55:32.647858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:32.649485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:32.704015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543dc97-cc53-45d2-b541-b6e3431426f3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:32.804225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:32.804853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:32.805316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:32.805600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] PATH_INFO: `/v3/projects/f9b20975774c4f6bb00cde34670a024f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:32.806745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b20975774c4f6bb00cde34670a024f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:32.809490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:32.972747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b20975774c4f6bb00cde34670a024f', 'request_id': 'req-0cd35ecc-6f73-475a-98cf-445d896fc8ff'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:32.989747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b20975774c4f6bb00cde34670a024f', 'request_id': 'req-0cd35ecc-6f73-475a-98cf-445d896fc8ff'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:33.094056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b20975774c4f6bb00cde34670a024f', 'request_id': 'req-0cd35ecc-6f73-475a-98cf-445d896fc8ff'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:33.107806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] The token cache is being invalidate because project f9b20975774c4f6bb00cde34670a024f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:33.108111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:33.108831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0cd35ecc-6f73-475a-98cf-445d896fc8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:33.112651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1071/2115] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:32 2022] DELETE /identity/v3/projects/f9b20975774c4f6bb00cde34670a024f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:33.120214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.121241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.121690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.154177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:33.155424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:33.228265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:33.243118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1045/2116] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:33.251547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.252091 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.252713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.281408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:33.284741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:33.298043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1072/2117] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:33.299301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.310497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea56aeb-e91b-4feb-a64a-272f9d75e3dc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.316031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.316787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.317129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.317466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.318190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:33.318579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.320492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:33.352699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1046/2118] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:33.353538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.359408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc229-d7f2-4d87-a6cb-52f1a577fbc7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.364831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.365449 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.365730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.366002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.366712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.369423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:33.515442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1073/2119] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:33 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:33.519387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.530295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a482-f3b1-4fde-a532-24a6a3c71378 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.611496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.612044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.612370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.612832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.613690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.616493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:33.818720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1047/2120] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:33 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:33.823766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.840810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce51e-2ed6-4aca-8b6b-0d081c249ba8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.846196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.846998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.847777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.847777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.848185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.849839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:33.864687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1074/2121] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:33.867211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.878591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c91c-cef5-4849-a565-7cca4177d7fb admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.883300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.884682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.885815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.886293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.887166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.888901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3e584-c1f7-4b40-bc1d-d8d9342663e2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:33.900723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1048/2122] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:33.905113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:33.915787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8bfe7-e931-4a8c-8494-2691d3ce6f1d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:33.920420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:33.921108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:33.921405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:33.921653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] PATH_INFO: `/v3/projects/7417f3d033ad4c208acb35be58b228c7/users/7746eb3431c44b18a6b7ef3bdad13d6c/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:33.923956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:33.937928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7417f3d033ad4c208acb35be58b228c7, user_id=7746eb3431c44b18a6b7ef3bdad13d6c, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:33.940724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:34.137222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1075/2123] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:33 2022] PUT /identity/v3/projects/7417f3d033ad4c208acb35be58b228c7/users/7746eb3431c44b18a6b7ef3bdad13d6c/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:34.147871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:34.148160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:34.148432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:34.177061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] MFA Rules not processed for user `7746eb3431c44b18a6b7ef3bdad13d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:34.178280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:34.267508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1049/2124] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:34.284118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:34.287724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:34.378772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f80-8eeb-458b-8205-b0be18343be7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:34.378772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:34.378772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:34.378772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:34.379494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:34.404890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:34.404890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ce3b8-7a6b-428c-a902-41633872e8d0 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:34.404890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1076/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:37.847761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:37.850076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:37.950104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:37.983961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a0592-a761-403d-bc3d-086e0e61b624 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:37.988921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:37.989623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:37.989900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:37.990333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] PATH_INFO: `/v3/users/c151a351cc894b1ea7785e433ed439ff` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:37.991797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c151a351cc894b1ea7785e433ed439ff)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:37.994135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:38.452937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c151a351cc894b1ea7785e433ed439ff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:38.453953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c151a351cc894b1ea7785e433ed439ff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:38.467078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c151a351cc894b1ea7785e433ed439ff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:38.469091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c151a351cc894b1ea7785e433ed439ff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:38.515445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c151a351cc894b1ea7785e433ed439ff'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:38.734582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1050/2126] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:37 2022] DELETE /identity/v3/users/c151a351cc894b1ea7785e433ed439ff => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:38.739818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:38.741911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:38.742345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:38.771402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:38.781702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:38.865217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1077/2127] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:38.877513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:38.879079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:38.947340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3547360-eda1-4e90-9638-5f6d76b84d8f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:38.961501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:38.962881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:38.964031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:38.964544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:38.979316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:38.980822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:38.991602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1051/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:39.609329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:39.611072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:39.625288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419629a-02dd-4508-aa96-fd2a6ac59d5a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:39.632195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:39.633267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:39.638495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:39.639787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] PATH_INFO: `/v3/projects/28857a7ffeac466dbf80e8d6d354c88e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:39.649080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=28857a7ffeac466dbf80e8d6d354c88e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:39.651788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:39.883681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28857a7ffeac466dbf80e8d6d354c88e', 'request_id': 'req-2e683f42-4295-4972-b9da-f18af37cf9ba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:39.904433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28857a7ffeac466dbf80e8d6d354c88e', 'request_id': 'req-2e683f42-4295-4972-b9da-f18af37cf9ba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.045666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28857a7ffeac466dbf80e8d6d354c88e', 'request_id': 'req-2e683f42-4295-4972-b9da-f18af37cf9ba'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.060113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] The token cache is being invalidate because project 28857a7ffeac466dbf80e8d6d354c88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:40.060410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.061590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e683f42-4295-4972-b9da-f18af37cf9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.065829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1078/2129] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:39 2022] DELETE /identity/v3/projects/28857a7ffeac466dbf80e8d6d354c88e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:40.067815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:40.081398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e5f9-dd91-44d1-8386-b77adce73db8 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:40.162863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:40.163853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:40.164382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:40.164864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] PATH_INFO: `/v3/users/a1670387d61d4f6f9c071a87da65ce34` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:40.166821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1670387d61d4f6f9c071a87da65ce34)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:40.169942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:40.401079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:40.403057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:40.403413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:40.425509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:40.434234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1670387d61d4f6f9c071a87da65ce34'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.435485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1670387d61d4f6f9c071a87da65ce34'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.438073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] MFA Rules not processed for user `5894f5698bd04431ae99eb287eb4cf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:40.442258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:40.447430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1670387d61d4f6f9c071a87da65ce34'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.448613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1670387d61d4f6f9c071a87da65ce34'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.464066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1670387d61d4f6f9c071a87da65ce34'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:40.522052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1079/2130] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:40.534944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:40.536480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:40.549545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1052/2131] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:40 2022] DELETE /identity/v3/users/a1670387d61d4f6f9c071a87da65ce34 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:40.597521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1488f7-73f4-4f1e-a9ae-be0687ba1629 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:40.673246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:40.674012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:40.674297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:40.674570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:40.676474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:40.686270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:40.741096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:40.742556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aee6ed-b1b7-4b06-8c1c-149a055525e4 service glance] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:40.752814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1080/2132] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:55:41.045277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:41.047535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.125232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4246-3a7a-44ab-afda-64b3f84a2983 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:41.130223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:41.130908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.131186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.131458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] PATH_INFO: `/v3/projects/aba9800c7932409a919182f0ba7d7142` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.132674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba9800c7932409a919182f0ba7d7142)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:41.138312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:41.184448 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.184961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.185084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.205247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:41.206441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.262203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1081/2133] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:41.309306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:41.311056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.317118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba9800c7932409a919182f0ba7d7142', 'request_id': 'req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:41.323077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba9800c7932409a919182f0ba7d7142', 'request_id': 'req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:41.383621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c53a9b-2910-42eb-b8f0-334004a841e8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:41.466665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba9800c7932409a919182f0ba7d7142', 'request_id': 'req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:41.569908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] The token cache is being invalidate because project aba9800c7932409a919182f0ba7d7142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:41.570354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:41.570660 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:41.571089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.571089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.571343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4c0408a5-dcfc-497e-ad4a-fe7d80d587a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:41.571778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.571875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1053/2134] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:41 2022] DELETE /identity/v3/projects/aba9800c7932409a919182f0ba7d7142 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:41.571973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.571973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:41.571973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80536-8783-42e7-83de-ed2f7e222107 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:41.575892 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.576315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.576619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.579988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1082/2135] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:55:41.628339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:41.633240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.766908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.767192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.767470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.771610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1054/2136] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:41.815000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:41.816417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:41.832373 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1083/2137] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:41.836849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:41.852567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4705-7bdf-4fd3-9365-d77db975690f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:41.871375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:41.872010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.872297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.872572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.873780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:41.873780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:41.875226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:41.907083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1055/2138] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:41.908696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:41.926129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566edd-f5c7-41b8-a7b5-446cbd4e31e3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:41.933264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:41.934191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:41.934706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:41.935178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:41.936038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:41.939433 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:42.141738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1084/2139] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:41 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:42.145833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:42.160876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf53f-a8ef-4855-baa8-2a97d7b63b74 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:42.330065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:42.331008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:42.331470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:42.334463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:42.335467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:42.339807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:42.527637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1056/2140] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:42 2022] POST /identity/v3/users => generated 288 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:55:42.528956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:42.546431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79df4-5926-48ca-b673-9a009c1bdca1 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:42.573450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:42.574279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:42.575182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:42.575889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:42.579390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:42.581767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:42.613297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1085/2141] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:42.614454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:42.635631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f0e3-3787-4bc6-b5e8-4d43dfb2190b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:42.635631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:42.635631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:42.635631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:42.635999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:42.635999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:42.637366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd65fa-726c-453e-b2a5-07528c16498e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:42.652522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1057/2142] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:42.657085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:42.691212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f936-64cc-47bb-90ba-665f9252cca7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:42.720862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:42.720862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:42.720862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:42.720862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] PATH_INFO: `/v3/projects/e5fefd0099ca46bfb1fe834f89ca495a/users/4057ac9fd9d843f1b7554348a1c210db/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:42.727894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fefd0099ca46bfb1fe834f89ca495a, user_id=4057ac9fd9d843f1b7554348a1c210db, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:42.732289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:43.039122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1086/2143] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:42 2022] PUT /identity/v3/projects/e5fefd0099ca46bfb1fe834f89ca495a/users/4057ac9fd9d843f1b7554348a1c210db/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:43.057471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:43.057815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:43.058034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:43.147609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] MFA Rules not processed for user `4057ac9fd9d843f1b7554348a1c210db`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:43.154913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:43.286441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1058/2144] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:43.323692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:43.327043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:43.453287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4e08e-ba66-4199-964e-cd19c639a94c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:43.464152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:43.465398 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:43.465912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:43.466601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:43.507439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:43.509553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc2bd-e94f-4cb5-bfa5-71465c3bfed9 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:43.533318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1087/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:47.413165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:47.673096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:48.829250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:52.448814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:52.487689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:52.620336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a32eb3-46f4-46e3-a386-ebae6a43e361 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:52.622555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:52.623228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:52.623506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:52.623777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] PATH_INFO: `/v3/users/4057ac9fd9d843f1b7554348a1c210db` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:52.625000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4057ac9fd9d843f1b7554348a1c210db)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:52.626983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:53.825259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4057ac9fd9d843f1b7554348a1c210db'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:53.826001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4057ac9fd9d843f1b7554348a1c210db'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:53.833008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4057ac9fd9d843f1b7554348a1c210db'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:53.833930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4057ac9fd9d843f1b7554348a1c210db'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:53.846506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4057ac9fd9d843f1b7554348a1c210db'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:53.974227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1059/2146] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:55:52 2022] DELETE /identity/v3/users/4057ac9fd9d843f1b7554348a1c210db => generated 0 bytes in 1527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:53.980992 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:53.982088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:53.982372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:54.013084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:54.014794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:54.090279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1088/2147] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:54.100299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:54.101781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:54.213654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecac78-39ad-40c3-ac1a-33c469113f81 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:54.218109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:54.218917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:54.219344 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:54.219785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:54.234107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:54.236113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600734d-2aaf-4347-af71-2cbcb08811f0 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:54.252019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1060/2148] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:55:55.098628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:55.100117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:55.112287 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719776-2733-4ef1-bf4a-605d24ff0aed None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:55.127903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:55.129255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.129949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.130508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] PATH_INFO: `/v3/projects/e5fefd0099ca46bfb1fe834f89ca495a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.138290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fefd0099ca46bfb1fe834f89ca495a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:55.140339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:55.251468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:55.266523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fefd0099ca46bfb1fe834f89ca495a', 'request_id': 'req-4a02b257-9a3d-40ed-b67f-d11db21f8562'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:55.272842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fefd0099ca46bfb1fe834f89ca495a', 'request_id': 'req-4a02b257-9a3d-40ed-b67f-d11db21f8562'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:55.284300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cace-db8e-4bcb-a7de-5f471523d0ed None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.284826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cace-db8e-4bcb-a7de-5f471523d0ed None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.284936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cace-db8e-4bcb-a7de-5f471523d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.304761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1644cace-db8e-4bcb-a7de-5f471523d0ed None None] MFA Rules not processed for user `406440356a1544f0920b59616e774d75`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:55.306248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1644cace-db8e-4bcb-a7de-5f471523d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:55.342239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:55.364423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1061/2149] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:55:55.376734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fefd0099ca46bfb1fe834f89ca495a', 'request_id': 'req-4a02b257-9a3d-40ed-b67f-d11db21f8562'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:55.390026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] The token cache is being invalidate because project e5fefd0099ca46bfb1fe834f89ca495a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:55:55.390576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:55.391310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4a02b257-9a3d-40ed-b67f-d11db21f8562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:55:55.394117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1089/2150] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:55:55 2022] DELETE /identity/v3/projects/e5fefd0099ca46bfb1fe834f89ca495a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:55.401861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.411731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.411731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.426642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:55.427996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:55.489949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1062/2151] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:55.499163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.499632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.499844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.521377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:55.523081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:55.533269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1090/2152] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:55.537790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:55.549103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f61fa6-68c2-4312-ad25-5b389b60834c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:55.556887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:55.556887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.556887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.556887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.557295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:55:55.557295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:55.558486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:55.576705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1063/2153] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:55:55.578508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:55.589370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa220d3-2ba0-4e26-aec8-c87090e3f8a0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:55.595494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:55.595828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.596338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.596747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.597513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:55.599515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:55.762135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1091/2154] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:55 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:55.767075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:55.778110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e7416-7e66-49da-8de1-6c8d2a6a2ccc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:55.838605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:55.839219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.839479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.839748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.840386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:55.842361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:55.966882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1064/2155] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:55 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:55.971097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:55.981683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daaf29-0c0d-419a-a44a-2e4643f47714 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:55.986255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:55.986850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:55.987129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:55.987397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:55.988037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:55.989670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.000063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1092/2156] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:56.003930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.020849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582bcb0-0b3a-4805-82b8-971839e3d719 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.027320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cad4-6456-4510-962d-cdc41074b3bf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.048052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1065/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:56.058247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.082446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f687cdc-8b91-4426-bdd4-c41f236cf805 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.097193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.097958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.098336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.098711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] PATH_INFO: `/v3/projects/439001756c4e40bbab93d6be7418e9be/users/49e33611dd5a4fdcb8177cc31331dd5e/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.116403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=439001756c4e40bbab93d6be7418e9be, user_id=49e33611dd5a4fdcb8177cc31331dd5e, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.119991 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.247481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1093/2158] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:56 2022] PUT /identity/v3/projects/439001756c4e40bbab93d6be7418e9be/users/49e33611dd5a4fdcb8177cc31331dd5e/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:56.258864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.259143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.260199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.288860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] MFA Rules not processed for user `49e33611dd5a4fdcb8177cc31331dd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:56.290064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:56.330767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:56.355030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1066/2159] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:56.360851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.424009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7ef77-3112-492f-a05e-69f73b9ea3bb admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.428707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.429310 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.429584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.429850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.430517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.433273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.531707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1094/2160] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:56 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:56.533062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.544707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ede97-a438-4cef-b9bf-949795a920a7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.606295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.606904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.607190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.607463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.608094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.610160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.707240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1067/2161] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:56 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:56.711707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.723812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c7a8-c2a9-4dc8-a6e7-ee6a7fe3c4d9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.728793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.729395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.729678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.729943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.730588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.732177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.743196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1095/2162] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:56.747249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.761674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a346c2-72fc-4718-b168-886b48a619d4 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.763675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.764219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.764508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.764810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.765458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.767100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99256bb-cf8b-4fbd-9e60-0fa1e49f5530 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.781738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1068/2163] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:55:56.783151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:56.793771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba9966-1d7d-4304-a385-f4da23061fc7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:56.798835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:56.799676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.801909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.801909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] PATH_INFO: `/v3/projects/a47d168c12e240908f82099b77b9df81/users/7f1dae20e088472f9d1353534f42da09/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:56.818039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47d168c12e240908f82099b77b9df81, user_id=7f1dae20e088472f9d1353534f42da09, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:56.820826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:56.915013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1096/2164] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:56 2022] PUT /identity/v3/projects/a47d168c12e240908f82099b77b9df81/users/7f1dae20e088472f9d1353534f42da09/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:56.983569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:56.983852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:56.984125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.012300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] MFA Rules not processed for user `7f1dae20e088472f9d1353534f42da09`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:57.013503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:57.078005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1069/2165] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:57.082452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.087116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:57.153289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bddeb8-50a8-417c-9c32-4ef139751661 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.158200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.158808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.159088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.159360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.160001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.162069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.291895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1097/2166] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:55:57 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:57.295920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.307082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bc301-8adc-439d-9f5b-1d5dec1e6494 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.352530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:57.365210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.365845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.366133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.366388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.367031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.369662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.564549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1070/2167] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:55:57 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:55:57.565806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.576522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655eafb-fec2-4c62-95cd-1abeb28cf158 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.581289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.581879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.582187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.582460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.583107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.585052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.596848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1098/2168] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:57.600828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.612376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c765f7-3ff9-4c42-ade1-c9c18fd272a0 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.616966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.617609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.617884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.618152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] PATH_INFO: `/v3/projects/0f616089652c447e8b0a1602dda5335a/users/8af0ea60855042aaa09d4d6af7132981/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.633225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f616089652c447e8b0a1602dda5335a, user_id=8af0ea60855042aaa09d4d6af7132981, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.635884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.700054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1071/2169] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:57 2022] PUT /identity/v3/projects/0f616089652c447e8b0a1602dda5335a/users/8af0ea60855042aaa09d4d6af7132981/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:57.704007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.715478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28577f7-e8c5-4ec0-8fad-15ae108d76f1 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.771652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.772254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.772533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.772837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.773476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.775769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50febe-6929-4974-82dd-adfcb04f5f22 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.785893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1099/2170] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:55:57.790137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.801193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75474-5787-4504-b8c0-88892bc5fe5a admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:57.805696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:57.806374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.806858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.806965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] PATH_INFO: `/v3/projects/0f616089652c447e8b0a1602dda5335a/users/8af0ea60855042aaa09d4d6af7132981/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.808882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f616089652c447e8b0a1602dda5335a, user_id=8af0ea60855042aaa09d4d6af7132981, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:57.811487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:57.821675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1072/2171] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:55:57 2022] PUT /identity/v3/projects/0f616089652c447e8b0a1602dda5335a/users/8af0ea60855042aaa09d4d6af7132981/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:55:57.831600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afde9-8abf-468d-a634-901ecf15032a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:57.832006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afde9-8abf-468d-a634-901ecf15032a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:57.832292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afde9-8abf-468d-a634-901ecf15032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:57.861838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-070afde9-8abf-468d-a634-901ecf15032a None None] MFA Rules not processed for user `8af0ea60855042aaa09d4d6af7132981`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:55:57.863058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-070afde9-8abf-468d-a634-901ecf15032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:57.927047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:55:57.932280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1100/2172] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:55:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:55:57.943680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:55:57.945490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:55:58.007291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af8eb4-da26-4c1c-a302-303874d674a9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:55:58.011776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:55:58.012410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:55:58.012725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:55:58.013002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:55:58.086784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:55:58.086784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:55:58.086784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1073/2173] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:55:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:00.587707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070afde9-8abf-468d-a634-901ecf15032a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:00.589377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-070afde9-8abf-468d-a634-901ecf15032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:00.616141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:00.625262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc82a7-c5a0-4a29-af6b-3c3425f858bf service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:00.628879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:00.629476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:00.629752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:00.630020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:00.660136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070afde9-8abf-468d-a634-901ecf15032a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:00.664963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:00.665717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:00.666163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:00.666455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] PATH_INFO: `/v3/users/9c1ec365f76d4189bd24b88234e8f38a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:00.667657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1ec365f76d4189bd24b88234e8f38a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:00.669643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:00.687116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:00.690867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:00.692706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81935961-8c5b-419d-a48b-0ad52f4776a7 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:00.706898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1074/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:00.941385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1ec365f76d4189bd24b88234e8f38a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:00.942115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1ec365f76d4189bd24b88234e8f38a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:00.949980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1ec365f76d4189bd24b88234e8f38a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:00.967632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1ec365f76d4189bd24b88234e8f38a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:00.968375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1ec365f76d4189bd24b88234e8f38a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.093116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1101/2175] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:00 2022] DELETE /identity/v3/users/9c1ec365f76d4189bd24b88234e8f38a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:01.097668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:01.097971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:01.098435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:01.127502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:01.130382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:01.194719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1075/2176] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:01.205597 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:01.207119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:01.266870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce71a4-1940-4fef-8fa0-0dda3ce69aac admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:01.270616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:01.271279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:01.271583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:01.271853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:01.281593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:01.283028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:01.292814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1102/2177] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:01.614045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:01.616169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:01.628665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874b10-b14f-4d55-8912-d5a62c2d5513 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:01.633612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:01.637279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:01.637279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:01.637279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] PATH_INFO: `/v3/users/da3082c6a8ae405d8ba4ed39cde48ee7` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:01.637279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3082c6a8ae405d8ba4ed39cde48ee7)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:01.638682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:01.870643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3082c6a8ae405d8ba4ed39cde48ee7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.871328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3082c6a8ae405d8ba4ed39cde48ee7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.878556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3082c6a8ae405d8ba4ed39cde48ee7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.879196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3082c6a8ae405d8ba4ed39cde48ee7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.891195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-248de785-021f-40bc-8997-0a321d9ba484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3082c6a8ae405d8ba4ed39cde48ee7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:01.961500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:01.964320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:01.981608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ba26-7bcc-4071-90f9-7cee8807206d service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:01.993426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1076/2178] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:01 2022] DELETE /identity/v3/users/da3082c6a8ae405d8ba4ed39cde48ee7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:01.998962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:01.999149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:01.999429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:02.002016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:02.003062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:02.003865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:02.004933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] PATH_INFO: `/v3/projects/740be0bf536742008e425b4abc49c07e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:02.006388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740be0bf536742008e425b4abc49c07e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:02.008447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:02.027216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:02.029308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:02.031598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:02.094376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1077/2179] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:02.110623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:02.112224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:02.123670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:02.192090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740be0bf536742008e425b4abc49c07e', 'request_id': 'req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.194408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf495fef-2b6a-46af-9c52-e83624733e95 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:02.203423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740be0bf536742008e425b4abc49c07e', 'request_id': 'req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.263901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:02.265453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:02.265453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:02.265453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:02.341091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:02.342805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:02.362486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1078/2180] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:02.445357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740be0bf536742008e425b4abc49c07e', 'request_id': 'req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.457717 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] The token cache is being invalidate because project 740be0bf536742008e425b4abc49c07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:02.458006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.458680 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.460770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1103/2181] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:01 2022] DELETE /identity/v3/projects/740be0bf536742008e425b4abc49c07e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:02.465540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:02.467275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:02.498017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2aa9a-8c56-4612-9b72-fda3b3053edb service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:02.514240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:02.515674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:02.515962 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:02.516250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] PATH_INFO: `/v3/users/7a616f5828e247c998f349af97a5c9b1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:02.518929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a616f5828e247c998f349af97a5c9b1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:02.523474 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:02.651320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:02.652818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:02.717601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77681-dc26-43ca-8889-ddc6dfb9f5f1 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:02.722063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:02.722701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:02.723175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:02.723546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:02.725427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:02.817111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:02.818645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb920ba-6bbb-4313-b700-fb6c47fcf112 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:02.830818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1104/2182] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:02.863312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a616f5828e247c998f349af97a5c9b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.864202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a616f5828e247c998f349af97a5c9b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.881967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a616f5828e247c998f349af97a5c9b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.882790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a616f5828e247c998f349af97a5c9b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:02.899118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a616f5828e247c998f349af97a5c9b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.062665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1079/2183] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:02 2022] DELETE /identity/v3/users/7a616f5828e247c998f349af97a5c9b1 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:03.262793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:03.270508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:03.270508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:03.274146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:03.277714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:03.291322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:03.292580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:03.386126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1105/2184] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:03.409463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:03.414650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:03.414898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18f74-ce9c-4ad7-ab4f-cae273dbeba5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:03.422807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:03.423977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:03.424256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:03.424526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] PATH_INFO: `/v3/projects/b74cbe0b8d7a4b6dbb6d8096caa3ef89` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:03.426003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74cbe0b8d7a4b6dbb6d8096caa3ef89)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:03.429223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:03.520479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:03.547346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14752d5-61cb-430a-82f1-ce4eeef66394 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:03.552872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:03.553489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:03.553769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:03.554421 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:03.563236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:03.564883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c66aa4-294e-4600-8614-4d8e3536fc1e service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:03.574320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1106/2185] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:56:03.618361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74cbe0b8d7a4b6dbb6d8096caa3ef89', 'request_id': 'req-871328dc-fc39-4a3b-8f4c-1acea6ec1159'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.618361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74cbe0b8d7a4b6dbb6d8096caa3ef89', 'request_id': 'req-871328dc-fc39-4a3b-8f4c-1acea6ec1159'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.767013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74cbe0b8d7a4b6dbb6d8096caa3ef89', 'request_id': 'req-871328dc-fc39-4a3b-8f4c-1acea6ec1159'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.823728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] The token cache is being invalidate because project b74cbe0b8d7a4b6dbb6d8096caa3ef89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:03.827363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.830199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:03.844339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1080/2186] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:03 2022] DELETE /identity/v3/projects/b74cbe0b8d7a4b6dbb6d8096caa3ef89 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:03.846463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236081-c32b-4d5b-aac1-c872e897aa2e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:03.846615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236081-c32b-4d5b-aac1-c872e897aa2e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:03.846965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26236081-c32b-4d5b-aac1-c872e897aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:03.932220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-26236081-c32b-4d5b-aac1-c872e897aa2e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:03.935884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-26236081-c32b-4d5b-aac1-c872e897aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:03.968969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:03.972213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:04.109130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:04.111850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1107/2187] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:04.124158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.124703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.125130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.173061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871328dc-fc39-4a3b-8f4c-1acea6ec1159 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.183982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.186131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.186421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.187381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] PATH_INFO: `/v3/projects/03acff8b22f94737bd556e9f8c7c9138` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.190310 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=03acff8b22f94737bd556e9f8c7c9138)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.193837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.226247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:04.228386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:04.293783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1108/2188] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:04.298767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.335836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b444-d0ed-4765-b997-24f922ead419 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.359077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.359981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.364253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.364253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.364253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:04.364253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.364253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.427805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1109/2189] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:56:04.432118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.438885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03acff8b22f94737bd556e9f8c7c9138', 'request_id': 'req-5febbb38-b3fa-41d3-b304-c6a9967e4fda'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:04.453898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a79e7a-d494-43f6-aa34-32384e35de92 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.463837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03acff8b22f94737bd556e9f8c7c9138', 'request_id': 'req-5febbb38-b3fa-41d3-b304-c6a9967e4fda'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:04.542684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03acff8b22f94737bd556e9f8c7c9138', 'request_id': 'req-5febbb38-b3fa-41d3-b304-c6a9967e4fda'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:04.562735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] The token cache is being invalidate because project 03acff8b22f94737bd556e9f8c7c9138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:04.563202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:04.564524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-5febbb38-b3fa-41d3-b304-c6a9967e4fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:04.566387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1081/2190] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:03 2022] DELETE /identity/v3/projects/03acff8b22f94737bd556e9f8c7c9138 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:04.572002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6f4-3785-4b5f-ba95-5dcfe922ad5d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.573190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6f4-3785-4b5f-ba95-5dcfe922ad5d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.573190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6f4-3785-4b5f-ba95-5dcfe922ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.601794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1c67c6f4-3785-4b5f-ba95-5dcfe922ad5d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:04.603281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1c67c6f4-3785-4b5f-ba95-5dcfe922ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:04.607784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.609573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.610095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.610577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.611598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.613881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.622975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1082/2191] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:04.624398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.624780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.625128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.656972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:04.658518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:04.669393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1083/2192] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:04.674414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.684374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2200f9-43d3-4953-9bbc-8cef516fcd9e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.689291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.689947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.690228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.693988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.693988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:04.693988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.693988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.705688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1084/2193] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:56:04.710362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.720523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9dc8-05ea-4a9b-897e-021a4ffa650e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.725487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.726085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.726361 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.726628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.727289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.730090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.762072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1110/2194] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/projects => generated 383 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:04.777990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.782357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:04.826600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1085/2195] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:56:04.830519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:04.862920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442220a8-5317-4e5a-94f8-1fc49a288f9b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.898697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd150ab-23c2-4d83-9c22-edb7f8f08523 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:04.904352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.904992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.905271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.905540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.906218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.908189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5459d3-20c0-4dd3-915c-714494549a95 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:04.923299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:04.923808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:04.924109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:04.924349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:04.925701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:04.927825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.077457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1086/2196] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:05.077457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.079306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.084446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.085443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1111/2197] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:04 2022] POST /identity/v3/users => generated 292 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:05.086588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.099155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1c8d1-ab14-4868-b55e-d57f69b14524 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.106357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.107430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.108066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.108544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.109418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.111563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.124359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] MFA Rules not processed for user `60c731fa91114cbebe4754e6e26ab756`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:05.127764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:05.144907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1112/2198] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:05.145701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.174587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c4ea-0f09-46af-be70-9b624d44b3da admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.188292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.189256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.189744 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.190196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.191085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.195757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.225638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1113/2199] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:05.226616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.231535 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1087/2200] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:05.234975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.246288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdf2d-3a2e-45d7-afb8-8ec4beb4569b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.253871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac3953-bc66-4e5b-9578-309fdc21fe54 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.266867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.266867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.266867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.266867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.267330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.268956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.269580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.269862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.270135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.270791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.271514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.273847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.294340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1114/2201] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:05.297874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.302217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1088/2202] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:05.310638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.332176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9cbe6-7153-4cc4-9697-e4ad41782185 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.346222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.346673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6588f-0982-4db4-badb-8f5aca6214ad admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.347440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.347890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.348313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] PATH_INFO: `/v3/projects/0295da3df0714c82bf889efeac970855/users/771d7e7b1ac54b828ee6daaf3a2a06cf/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.366955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.370113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.370113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.370113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] PATH_INFO: `/v3/projects/2a90d07ef14a4b61b20df9fa019d4b47/users/a8cf2683834d46fbae7c61be5d4e693b/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.376437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295da3df0714c82bf889efeac970855, user_id=771d7e7b1ac54b828ee6daaf3a2a06cf, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.379542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbe46-c4de-4b6e-b57b-044982d8698e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.392514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:05.414419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a90d07ef14a4b61b20df9fa019d4b47, user_id=a8cf2683834d46fbae7c61be5d4e693b, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.417481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e52b1-e31b-42ca-b8dd-d8474f54728e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:05.453137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1115/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:05 2022] PUT /identity/v3/projects/0295da3df0714c82bf889efeac970855/users/771d7e7b1ac54b828ee6daaf3a2a06cf/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:05.466112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.466770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.467790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.514995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] MFA Rules not processed for user `771d7e7b1ac54b828ee6daaf3a2a06cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:05.517537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:05.590144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1089/2204] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:05 2022] PUT /identity/v3/projects/2a90d07ef14a4b61b20df9fa019d4b47/users/a8cf2683834d46fbae7c61be5d4e693b/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:05.601255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.601551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.601807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.659893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1116/2205] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:05.664550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.672124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] MFA Rules not processed for user `a8cf2683834d46fbae7c61be5d4e693b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:05.675550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:05.817834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463e3b7-b4bc-451e-a3ed-57eb3b240ae8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:05.877292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1090/2206] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:05.888337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:05.890984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:05.900486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:05.949710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:05.950711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:05.951145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:05.951519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:05.952779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:05.955166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:06.017791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f542-45a5-4c80-a30b-81e49b7be19f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:06.021981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:06.026776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:06.026776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:06.026776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:06.039643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:06.041302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:06.092229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1091/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:06.141315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1117/2208] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:05 2022] POST /identity/v3/projects => generated 387 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:06.144886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:06.161719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe4e0-e61e-4d03-bbcb-cdba7e931257 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:06.378188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:06.380498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:06.381034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:06.382358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:06.386060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:06.388871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:06.487834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:06.565800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1092/2209] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:06 2022] POST /identity/v3/users => generated 300 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:06.569636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:06.591180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1860a9-1569-4cc6-b8ce-d7f136d95734 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:06.601902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:06.603774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:06.604037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:06.605751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:06.608222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:06.611158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:06.635976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1118/2210] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:06.640004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:06.655224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9a94-c06f-4f52-8e48-ab87f2fff6bc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:06.666435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:06.667381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:06.667663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:06.667935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] PATH_INFO: `/v3/projects/13ca02d417d547d1b7ce8134d013e1fa/users/ab99433a85374e8b8fbdcaaaa01fd8c7/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:06.702281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ca02d417d547d1b7ce8134d013e1fa, user_id=ab99433a85374e8b8fbdcaaaa01fd8c7, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:06.706414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:06.812238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1093/2211] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:06 2022] PUT /identity/v3/projects/13ca02d417d547d1b7ce8134d013e1fa/users/ab99433a85374e8b8fbdcaaaa01fd8c7/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:06.816532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:06.831001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325768-ff1e-4e3f-b3b3-f97809f696d3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:07.069798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:07.070258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:07.070258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:07.070527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:07.081587 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:07.089220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8238237-fa69-4653-8464-76f6d8d1b61c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:07.123295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1119/2212] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:07.126353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:07.151210 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db716-83b3-4c35-bdc7-8981a4502bb8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:07.170931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:07.171564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:07.171847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:07.172124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] PATH_INFO: `/v3/projects/13ca02d417d547d1b7ce8134d013e1fa/users/ab99433a85374e8b8fbdcaaaa01fd8c7/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:07.179206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ca02d417d547d1b7ce8134d013e1fa, user_id=ab99433a85374e8b8fbdcaaaa01fd8c7, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:07.188788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:07.221181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1094/2213] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:07 2022] PUT /identity/v3/projects/13ca02d417d547d1b7ce8134d013e1fa/users/ab99433a85374e8b8fbdcaaaa01fd8c7/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:07.225137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:07.225427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:07.225727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:07.311470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] MFA Rules not processed for user `ab99433a85374e8b8fbdcaaaa01fd8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:07.313141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:07.461044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1120/2214] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:07.549227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:07.555231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:07.713901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdaa05-5419-4978-95ce-7d28b2b08790 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:07.713901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:07.713901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:07.713901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:07.714838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:07.714838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:07.714838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:07.724914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1095/2215] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:08.191904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:08.318140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530d81-16a6-48ac-a8c1-9ecbf8aa9e29 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:08.324173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:08.324745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:08.325022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:08.325434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] PATH_INFO: `/v3/users/771d7e7b1ac54b828ee6daaf3a2a06cf` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:08.326571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=771d7e7b1ac54b828ee6daaf3a2a06cf)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:08.328571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:08.553013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:08.673608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771d7e7b1ac54b828ee6daaf3a2a06cf'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:08.674275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771d7e7b1ac54b828ee6daaf3a2a06cf'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:08.683908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771d7e7b1ac54b828ee6daaf3a2a06cf'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:08.710025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771d7e7b1ac54b828ee6daaf3a2a06cf'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:08.711056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-216b58cd-bafa-46cf-9eb5-0b0c8a6baa7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771d7e7b1ac54b828ee6daaf3a2a06cf'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:08.795454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:08.798028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:08.816513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d757-f68b-4077-89f2-9292437ddd04 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:08.821173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:08.822389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:08.823076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:08.823356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] PATH_INFO: `/v3/users/49e33611dd5a4fdcb8177cc31331dd5e` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:08.824500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e33611dd5a4fdcb8177cc31331dd5e)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:08.826612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:08.889302 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1121/2216] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:08 2022] DELETE /identity/v3/users/771d7e7b1ac54b828ee6daaf3a2a06cf => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:08.893711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:08.894000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:08.894282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:08.952170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:08.952170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:09.040242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1122/2217] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:09.062942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:09.067487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:09.117321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e33611dd5a4fdcb8177cc31331dd5e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:09.118032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e33611dd5a4fdcb8177cc31331dd5e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:09.132579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e33611dd5a4fdcb8177cc31331dd5e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:09.139859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e33611dd5a4fdcb8177cc31331dd5e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:09.174878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e33611dd5a4fdcb8177cc31331dd5e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:09.206910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef604-8ca4-47fb-816f-777164a17533 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:09.212335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:09.213692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:09.213976 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:09.214251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:09.216249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:09.241887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:09.245968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf122-8e17-46a4-b24e-25f2b42abea4 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:09.267516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1123/2218] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:09.292680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1096/2219] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:08 2022] DELETE /identity/v3/users/49e33611dd5a4fdcb8177cc31331dd5e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:09.297076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:09.297856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:09.298619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:09.331876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:09.331876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:09.456914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1124/2220] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:09.459317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:09.461573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:09.543876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4f962-59b4-48dc-9663-72735770e0ec admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:09.547739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:09.548702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:09.549234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:09.549519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:09.578311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:09.580429 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:09.597902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1097/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:09.619830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:10.119720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:10.123599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:10.180532 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d51f-dd7b-4c48-8a22-1cbda9ba6974 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:10.194844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:10.195690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:10.195978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:10.196805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] PATH_INFO: `/v3/projects/0295da3df0714c82bf889efeac970855` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:10.198341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0295da3df0714c82bf889efeac970855)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:10.201430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:10.408854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0295da3df0714c82bf889efeac970855', 'request_id': 'req-5f58ed18-7ebf-41f8-9572-96d345e165b9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.425423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0295da3df0714c82bf889efeac970855', 'request_id': 'req-5f58ed18-7ebf-41f8-9572-96d345e165b9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.463635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:10.465647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:10.481899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a63774-daad-4f95-b182-4ef43c4bd0f2 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:10.572370 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0295da3df0714c82bf889efeac970855', 'request_id': 'req-5f58ed18-7ebf-41f8-9572-96d345e165b9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.593623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] The token cache is being invalidate because project 0295da3df0714c82bf889efeac970855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:10.594222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.595015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.597075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1125/2222] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:10 2022] DELETE /identity/v3/projects/0295da3df0714c82bf889efeac970855 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:10.601714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:10.604743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:10.608721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:10.609740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:10.610337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:10.610929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] PATH_INFO: `/v3/projects/439001756c4e40bbab93d6be7418e9be` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:10.612888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439001756c4e40bbab93d6be7418e9be)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:10.625567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:10.628071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58ed18-7ebf-41f8-9572-96d345e165b9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:10.636388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:10.637642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:10.637921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:10.638362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] PATH_INFO: `/v3/users/ab99433a85374e8b8fbdcaaaa01fd8c7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:10.639786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab99433a85374e8b8fbdcaaaa01fd8c7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:10.642343 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:10.899958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439001756c4e40bbab93d6be7418e9be', 'request_id': 'req-3db3cfbb-aac9-4245-a3c9-51015741c0f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:10.907231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439001756c4e40bbab93d6be7418e9be', 'request_id': 'req-3db3cfbb-aac9-4245-a3c9-51015741c0f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.064441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439001756c4e40bbab93d6be7418e9be', 'request_id': 'req-3db3cfbb-aac9-4245-a3c9-51015741c0f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.086721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] The token cache is being invalidate because project 439001756c4e40bbab93d6be7418e9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:11.087983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.088932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.089999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab99433a85374e8b8fbdcaaaa01fd8c7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.091101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab99433a85374e8b8fbdcaaaa01fd8c7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.091752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1098/2223] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:10 2022] DELETE /identity/v3/projects/439001756c4e40bbab93d6be7418e9be => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:11.096559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:11.101575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:11.116013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab99433a85374e8b8fbdcaaaa01fd8c7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.130402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab99433a85374e8b8fbdcaaaa01fd8c7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.131392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab99433a85374e8b8fbdcaaaa01fd8c7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.211501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3cfbb-aac9-4245-a3c9-51015741c0f1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:11.218059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:11.218901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:11.219371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:11.219858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] PATH_INFO: `/v3/users/7f1dae20e088472f9d1353534f42da09` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:11.224407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1dae20e088472f9d1353534f42da09)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:11.224407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:11.269571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1126/2224] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:10 2022] DELETE /identity/v3/users/ab99433a85374e8b8fbdcaaaa01fd8c7 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:11.402141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1dae20e088472f9d1353534f42da09'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.403723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1dae20e088472f9d1353534f42da09'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.413522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1dae20e088472f9d1353534f42da09'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.414542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1dae20e088472f9d1353534f42da09'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.429160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e5ec2e71-18cc-41ff-be95-b02c65cdff68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1dae20e088472f9d1353534f42da09'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:11.470847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:11.472376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:11.547643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1099/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:11 2022] DELETE /identity/v3/users/7f1dae20e088472f9d1353534f42da09 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:11.593551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad52e-1910-47e4-8874-2ca6ad807cbc admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:11.688615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:11.689610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:11.690729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:11.691234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] PATH_INFO: `/v3/users/a8cf2683834d46fbae7c61be5d4e693b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:11.693076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cf2683834d46fbae7c61be5d4e693b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:11.700140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:12.001264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cf2683834d46fbae7c61be5d4e693b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.006458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cf2683834d46fbae7c61be5d4e693b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.028344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cf2683834d46fbae7c61be5d4e693b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.061212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cf2683834d46fbae7c61be5d4e693b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.062036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cf2683834d46fbae7c61be5d4e693b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.154341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:12.248637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1127/2226] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:11 2022] DELETE /identity/v3/users/a8cf2683834d46fbae7c61be5d4e693b => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:12.253566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.254152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.254252 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.278403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:12.280290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.283629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:12.285165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.401963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1100/2227] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:12.412809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:12.414557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.462925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09d7af-ac90-4952-a3bc-e854486bdeed admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:12.475265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:12.480582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.481106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.481621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] PATH_INFO: `/v3/projects/13ca02d417d547d1b7ce8134d013e1fa` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.483078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ca02d417d547d1b7ce8134d013e1fa)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:12.485537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:12.486894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:12.526443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08724cbb-3754-4660-8a15-e1eeccff3233 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:12.543076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:12.545755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.549180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.550572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.572832 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:12.575166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:12.602427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1101/2228] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:12.670379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ca02d417d547d1b7ce8134d013e1fa', 'request_id': 'req-648e0ec0-b7b4-4028-ae13-52477c09dad4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.684739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ca02d417d547d1b7ce8134d013e1fa', 'request_id': 'req-648e0ec0-b7b4-4028-ae13-52477c09dad4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.724157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:12.726261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.756876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53f25-3be0-4dd9-9c9c-ecec670e8256 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:12.822602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ca02d417d547d1b7ce8134d013e1fa', 'request_id': 'req-648e0ec0-b7b4-4028-ae13-52477c09dad4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.861914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] The token cache is being invalidate because project 13ca02d417d547d1b7ce8134d013e1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:12.863487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:12.864133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.864411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.864543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.864722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] PATH_INFO: `/v3/projects/a47d168c12e240908f82099b77b9df81` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.866193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47d168c12e240908f82099b77b9df81)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:12.868103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-648e0ec0-b7b4-4028-ae13-52477c09dad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:12.877481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1128/2229] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:12 2022] DELETE /identity/v3/projects/13ca02d417d547d1b7ce8134d013e1fa => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:12.879202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f6f1-0f1a-4b1a-823b-eb069abd3997 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.879484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f6f1-0f1a-4b1a-823b-eb069abd3997 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.879779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f6f1-0f1a-4b1a-823b-eb069abd3997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.880042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:12.902404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4458f6f1-0f1a-4b1a-823b-eb069abd3997 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:12.903683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4458f6f1-0f1a-4b1a-823b-eb069abd3997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.919086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1129/2230] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:12.921494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:12.921946 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:12.922351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:12.953522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:12.955265 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:12.967890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1130/2231] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:12.969332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.001784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da03b72-3db5-4be1-a612-b76126cad403 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:13.008677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:13.013882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:13.026989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1131/2232] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:56:13.045716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.058200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e369292-8beb-4647-95fa-9b49d02a246b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:13.077114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47d168c12e240908f82099b77b9df81', 'request_id': 'req-2a2db875-8f66-44a2-b3d8-672c28fd255f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.091289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47d168c12e240908f82099b77b9df81', 'request_id': 'req-2a2db875-8f66-44a2-b3d8-672c28fd255f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.214918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:13.215577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:13.215978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:13.216117 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:13.216793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:13.218714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:13.280490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47d168c12e240908f82099b77b9df81', 'request_id': 'req-2a2db875-8f66-44a2-b3d8-672c28fd255f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.298989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] The token cache is being invalidate because project a47d168c12e240908f82099b77b9df81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:13.300437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.301480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.306503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1102/2233] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:12 2022] DELETE /identity/v3/projects/a47d168c12e240908f82099b77b9df81 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:13.311388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.313094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:13.335847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db875-8f66-44a2-b3d8-672c28fd255f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:13.342809 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:13.343599 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:13.343882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:13.344159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] PATH_INFO: `/v3/users/8af0ea60855042aaa09d4d6af7132981` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:13.345461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af0ea60855042aaa09d4d6af7132981)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:13.347422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:13.448606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1132/2234] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:13 2022] POST /identity/v3/projects => generated 377 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:13.453149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.455683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:13.606425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af0ea60855042aaa09d4d6af7132981'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.607373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af0ea60855042aaa09d4d6af7132981'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.623914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af0ea60855042aaa09d4d6af7132981'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.635803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746823dc-04bb-4558-8048-5828823470c5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:13.642815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af0ea60855042aaa09d4d6af7132981'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.670845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:13.670845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:13.670845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:13.670845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:13.671349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:13.671436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:13.694907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af0ea60855042aaa09d4d6af7132981'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:13.770141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1133/2235] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:13 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:13.771177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.773856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:13.795654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1103/2236] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:13 2022] DELETE /identity/v3/users/8af0ea60855042aaa09d4d6af7132981 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:13.797258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:13.798788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:13.801529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:13.807195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f52b9-1249-45a6-92e4-fca1b19698dc admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:13.891736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:13.892625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:13.893006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:13.893356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] PATH_INFO: `/v3/projects/2a90d07ef14a4b61b20df9fa019d4b47` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:13.894704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a90d07ef14a4b61b20df9fa019d4b47)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:13.897286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:13.984130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:14.010543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759522d-c5ab-4062-aedc-d7ea72886baf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.016319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.017451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.017828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.018346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.019897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.021776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.037301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1104/2237] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:14.041105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.054617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4b3f-b8dc-4673-86aa-86388da1034b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.093336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a90d07ef14a4b61b20df9fa019d4b47', 'request_id': 'req-7d237157-ab59-46fb-9513-38e7bd7f97c6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.113666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a90d07ef14a4b61b20df9fa019d4b47', 'request_id': 'req-7d237157-ab59-46fb-9513-38e7bd7f97c6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.143979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.144914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.145438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.145877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.161063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.161063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.181370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1105/2238] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:14.187912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.223003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a90d07ef14a4b61b20df9fa019d4b47', 'request_id': 'req-7d237157-ab59-46fb-9513-38e7bd7f97c6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.242601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ba1b-16f8-4e4d-afe8-a3f0981c1258 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.251864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] The token cache is being invalidate because project 2a90d07ef14a4b61b20df9fa019d4b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:14.252165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.265523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7d237157-ab59-46fb-9513-38e7bd7f97c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.273732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1134/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:13 2022] DELETE /identity/v3/projects/2a90d07ef14a4b61b20df9fa019d4b47 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:14.273865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.273865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.273865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.273865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] PATH_INFO: `/v3/projects/3a0a1b0f05464c3aaf47a3b6f9927ce8/users/7433f3787f0f47aa96ff92b05e3a689a/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.279746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0497-145d-4b41-ae68-de61190e3b6e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.280042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0497-145d-4b41-ae68-de61190e3b6e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.280300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0497-145d-4b41-ae68-de61190e3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.328862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0a1b0f05464c3aaf47a3b6f9927ce8, user_id=7433f3787f0f47aa96ff92b05e3a689a, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.346309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbfb29-d772-4563-8c6e-868f2382f02b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.355630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-59cc0497-145d-4b41-ae68-de61190e3b6e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:14.356978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59cc0497-145d-4b41-ae68-de61190e3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:14.374857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1135/2240] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:14.384552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.386303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.387394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.434974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:14.436463 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:14.460013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1106/2241] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:14 2022] PUT /identity/v3/projects/3a0a1b0f05464c3aaf47a3b6f9927ce8/users/7433f3787f0f47aa96ff92b05e3a689a/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:14.473486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.476693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.476693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.518533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] MFA Rules not processed for user `7433f3787f0f47aa96ff92b05e3a689a`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:14.519767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:14.550897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1136/2242] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:14.556905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.572208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e3877-3537-4cd0-a317-30827fb66344 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.576985 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.577799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.578179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.578513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.579178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:14.580227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.582159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.623765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1137/2243] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:56:14.629458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.631394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:14.632028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1107/2244] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:14.633391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.654074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14abe-0ab3-49c8-b4f3-5217f09bf8ab admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.660757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4573a09-221d-480b-8c19-392dcff267d6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:14.669249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.669991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:14.670697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.670822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:14.671171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.671411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:14.671835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.671971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] PATH_INFO: `/v3/projects/0f616089652c447e8b0a1602dda5335a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:14.673467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f616089652c447e8b0a1602dda5335a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.673753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:14.676402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.677458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:14.781514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1108/2245] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:14 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:14.782774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:14.786489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:14.857766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f616089652c447e8b0a1602dda5335a', 'request_id': 'req-4bbfc420-c013-4f5f-a8af-f28251b0255e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.867749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f616089652c447e8b0a1602dda5335a', 'request_id': 'req-4bbfc420-c013-4f5f-a8af-f28251b0255e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:14.918470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db7ce-4745-44f5-89fc-d82fad33830c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.019100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f616089652c447e8b0a1602dda5335a', 'request_id': 'req-4bbfc420-c013-4f5f-a8af-f28251b0255e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:15.054789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] The token cache is being invalidate because project 0f616089652c447e8b0a1602dda5335a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:15.055159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:15.057300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:15.074807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1138/2246] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:14 2022] DELETE /identity/v3/projects/0f616089652c447e8b0a1602dda5335a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:15.077566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.081813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.082104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.082517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.083274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.085550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.085750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.093360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:15.132933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc420-c013-4f5f-a8af-f28251b0255e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.142644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.143288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.143614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.144003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.144697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.148539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.273679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1109/2247] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:14 2022] POST /identity/v3/projects => generated 379 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:15.288529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.299583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:15.301137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1139/2248] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:15 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:15.305780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.320154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568670be-92d1-402e-a89d-8c92970730b7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.414614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.415814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.419468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.419775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.421041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.422894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.430196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563d316-c2b1-451c-ab54-7d3b1d7c1f7e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.436998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.442356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.442356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.442356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.442693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1140/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:15.442808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.442808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.442983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.463306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a13eb-dd59-49d6-afc3-f9cde16df9ae admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.469560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.476856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.476856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.476856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.476856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.476856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.491031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1141/2250] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:15.492240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.514747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0b71e-93c6-4e0c-bfab-24d336db952d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.544317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.545697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.545697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.551742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] PATH_INFO: `/v3/projects/297ecde5866e4d59a15299ec9df9e728/users/a2bdfcb2c7fc41678f03655705a365b0/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.580229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1110/2251] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:15 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:15.588845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.612759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c403ca-1546-476b-82bc-51fa145d5cf6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.616019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=297ecde5866e4d59a15299ec9df9e728, user_id=a2bdfcb2c7fc41678f03655705a365b0, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.620286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae860-deb5-44aa-849a-697e94c5e98a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.621857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.622843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.623405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.624101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.625238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.627588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.647327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1111/2252] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:15.653709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.693482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5dc4d-d0cd-401b-a723-a106785ff278 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.704292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.704292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.705345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.705345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.705520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.707127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.735354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1112/2253] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:15.736314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:15.745060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1142/2254] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:15 2022] PUT /identity/v3/projects/297ecde5866e4d59a15299ec9df9e728/users/a2bdfcb2c7fc41678f03655705a365b0/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:15.760913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90f58-1be7-4bd3-be23-00a048f55e13 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:15.762658 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838c4c-2ade-4d1b-be05-d40f5a5e73c8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.762941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838c4c-2ade-4d1b-be05-d40f5a5e73c8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.763218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838c4c-2ade-4d1b-be05-d40f5a5e73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.835379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a9838c4c-2ade-4d1b-be05-d40f5a5e73c8 None None] MFA Rules not processed for user `a2bdfcb2c7fc41678f03655705a365b0`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:15.837079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a9838c4c-2ade-4d1b-be05-d40f5a5e73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:15.846995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:15.902220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:15.903325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.903766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.904041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] PATH_INFO: `/v3/projects/145f94a3de7b45258d4ec8687e488f38/users/27af5fb308fb47059653b2473708bb65/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.925507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=145f94a3de7b45258d4ec8687e488f38, user_id=27af5fb308fb47059653b2473708bb65, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:15.930023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:15.932625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1143/2255] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:15.933945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a56f-d4e1-4440-b293-b1e1b70388e1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:15.934355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a56f-d4e1-4440-b293-b1e1b70388e1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:15.935288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a56f-d4e1-4440-b293-b1e1b70388e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:15.965761 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8cd9a56f-d4e1-4440-b293-b1e1b70388e1 None None] MFA Rules not processed for user `76d057c5f1ca479d87271cc0ed710c12`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:15.967137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8cd9a56f-d4e1-4440-b293-b1e1b70388e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:16.000937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1113/2256] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:15 2022] PUT /identity/v3/projects/145f94a3de7b45258d4ec8687e488f38/users/27af5fb308fb47059653b2473708bb65/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:16.012234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.014024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:16.054945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1144/2257] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:16.057360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.057753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.058098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.111753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:16.115344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] MFA Rules not processed for user `27af5fb308fb47059653b2473708bb65`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:16.116629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:16.120151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71381568-50a2-4926-9584-8556f34e7dee admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:16.136989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:16.137705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.138072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.138433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.216621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1145/2258] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:16.216621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.225049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:16.226587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:16.242038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1114/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:16.312031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9cd61-9f2b-4e82-880b-1e5884a3ee1e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:16.318353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:16.321280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.321280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.321280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.321280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:16.324674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:16.422407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1146/2260] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:56:16.426431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.438013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c808-b6dd-43df-859c-bb6bcfdf2604 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:16.520926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:16.521637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.521976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.522315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.523023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:16.525120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:16.686076 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1115/2261] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:16 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:56:16.691002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.704807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6ec01-a1f1-4eef-a14b-3e31917c8031 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:16.715998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:16.716131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.716496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.718009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.718009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:16.720804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:16.744269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1147/2262] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:16.748552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.762049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43418b-c001-464d-a761-5013b617abbf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:16.768241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:16.774112 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:16.779059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:16.779059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] PATH_INFO: `/v3/projects/fe68288103184d2eaa65c2586ce6884f/users/6d8707482cdb4540a8d40606c695fb1a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:16.794635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe68288103184d2eaa65c2586ce6884f, user_id=6d8707482cdb4540a8d40606c695fb1a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:16.798208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:16.921897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1116/2263] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:16 2022] PUT /identity/v3/projects/fe68288103184d2eaa65c2586ce6884f/users/6d8707482cdb4540a8d40606c695fb1a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:16.926491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:16.939142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03f28e-cd47-41cd-ba9a-9ed97de3fe8c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:17.003379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:17.004058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.004336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.004670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.005365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:17.007049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f78e6-ce61-40af-b5be-79842646be38 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:17.021656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1148/2264] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:17.023051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:17.035955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24613f03-13e9-4ec7-95be-89f855ad6082 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:17.042134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:17.042818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.043118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.043393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] PATH_INFO: `/v3/projects/fe68288103184d2eaa65c2586ce6884f/users/6d8707482cdb4540a8d40606c695fb1a/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.045414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe68288103184d2eaa65c2586ce6884f, user_id=6d8707482cdb4540a8d40606c695fb1a, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:17.048064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:17.062251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1117/2265] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:17 2022] PUT /identity/v3/projects/fe68288103184d2eaa65c2586ce6884f/users/6d8707482cdb4540a8d40606c695fb1a/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:17.073209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.073492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.073797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.106699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] MFA Rules not processed for user `6d8707482cdb4540a8d40606c695fb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:17.108014 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:17.192735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1149/2266] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:17.209645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:17.211447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:17.304830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683b79-87f9-4638-a731-c1adb296bb5e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:17.309213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:17.309829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.310382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.310663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.322733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:17.324194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd58591-8722-4cbc-846c-cec8477c490d service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:17.335209 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1118/2267] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:17.523964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:17.547011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768fff6-1d18-441f-9931-9054fce7f162 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:17.568525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:17.569182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.569462 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.569743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.575071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:17.668459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:17.670245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:17.691749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1150/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:17.797878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b3f3-3ca3-41d1-bd3b-9ebfbdd71040 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:17.797878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b3f3-3ca3-41d1-bd3b-9ebfbdd71040 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:17.797878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491b3f3-3ca3-41d1-bd3b-9ebfbdd71040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:17.817616 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8491b3f3-3ca3-41d1-bd3b-9ebfbdd71040 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:17.819115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8491b3f3-3ca3-41d1-bd3b-9ebfbdd71040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:17.944321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1119/2269] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:56:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:17.959969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:17.959969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:18.052727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d3dd1-68de-4a19-aba8-851df837f267 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:18.062505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:18.063136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:18.063492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:18.063774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:18.081313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:18.083317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:18.093797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1151/2270] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:56:18.367893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85850-8414-4d1f-a2b3-09a9e5667aa2 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:18.368957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85850-8414-4d1f-a2b3-09a9e5667aa2 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:18.369601 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce85850-8414-4d1f-a2b3-09a9e5667aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:18.377240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:18.397720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5ce85850-8414-4d1f-a2b3-09a9e5667aa2 None None] MFA Rules not processed for user `a2bdfcb2c7fc41678f03655705a365b0`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:18.401430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5ce85850-8414-4d1f-a2b3-09a9e5667aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:18.541026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1120/2271] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:18.621125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:23.675486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:23.798115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:23.893080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7ad8-e145-43d5-9b4a-632d5f1e8c9a service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:23.900796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:23.901796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:23.902308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:23.902806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] PATH_INFO: `/v3/users/7433f3787f0f47aa96ff92b05e3a689a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:23.904353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7433f3787f0f47aa96ff92b05e3a689a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:23.906928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:24.091522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:24.301206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7433f3787f0f47aa96ff92b05e3a689a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:24.303136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7433f3787f0f47aa96ff92b05e3a689a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:24.342374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7433f3787f0f47aa96ff92b05e3a689a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:24.381961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7433f3787f0f47aa96ff92b05e3a689a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:24.382809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7433f3787f0f47aa96ff92b05e3a689a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:24.529314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1152/2272] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:23 2022] DELETE /identity/v3/users/7433f3787f0f47aa96ff92b05e3a689a => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:24.533543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:24.534111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:24.534624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:24.567541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:24.569057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:24.674749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1121/2273] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:24.693294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:24.693294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:24.803978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1ad3-c6b7-46c0-94c2-bc417358aae8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:24.808981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:24.809867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:24.810318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:24.810736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:24.828279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:24.830607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:24.849219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1153/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:25.909942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:25.911592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:25.927908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be048-28b1-4fdd-94f9-7c642f873e9b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:25.935848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:25.946784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:25.948227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:25.948756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] PATH_INFO: `/v3/projects/3a0a1b0f05464c3aaf47a3b6f9927ce8` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:25.953052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0a1b0f05464c3aaf47a3b6f9927ce8)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:25.960561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:26.129309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0a1b0f05464c3aaf47a3b6f9927ce8', 'request_id': 'req-2076dde2-a2a7-4e39-a19c-dfec4b608e03'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.135600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0a1b0f05464c3aaf47a3b6f9927ce8', 'request_id': 'req-2076dde2-a2a7-4e39-a19c-dfec4b608e03'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.259274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0a1b0f05464c3aaf47a3b6f9927ce8', 'request_id': 'req-2076dde2-a2a7-4e39-a19c-dfec4b608e03'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.283041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] The token cache is being invalidate because project 3a0a1b0f05464c3aaf47a3b6f9927ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:26.283345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.286749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.294850 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1122/2275] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:25 2022] DELETE /identity/v3/projects/3a0a1b0f05464c3aaf47a3b6f9927ce8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:26.296035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:26.323569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571a7f-1980-4816-bd83-b998b4c05ba5 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:26.523330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:26.525049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:26.525625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:26.526164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] PATH_INFO: `/v3/users/27af5fb308fb47059653b2473708bb65` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:26.527871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=27af5fb308fb47059653b2473708bb65)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:26.530411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:26.917654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:26.942425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27af5fb308fb47059653b2473708bb65'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.943503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27af5fb308fb47059653b2473708bb65'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.961317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27af5fb308fb47059653b2473708bb65'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.995837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27af5fb308fb47059653b2473708bb65'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:26.997447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27af5fb308fb47059653b2473708bb65'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:27.144890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1154/2276] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:26 2022] DELETE /identity/v3/users/27af5fb308fb47059653b2473708bb65 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:27.400580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:28.339058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:28.341461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:28.370506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076dde2-a2a7-4e39-a19c-dfec4b608e03 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:28.498301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:28.499733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:28.500182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:28.500695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] PATH_INFO: `/v3/projects/145f94a3de7b45258d4ec8687e488f38` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:28.502355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145f94a3de7b45258d4ec8687e488f38)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:28.505632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:28.745211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145f94a3de7b45258d4ec8687e488f38', 'request_id': 'req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:28.781302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145f94a3de7b45258d4ec8687e488f38', 'request_id': 'req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:28.869996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145f94a3de7b45258d4ec8687e488f38', 'request_id': 'req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:28.895131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] The token cache is being invalidate because project 145f94a3de7b45258d4ec8687e488f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:28.895486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:28.896182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:28.901116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1123/2277] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:28 2022] DELETE /identity/v3/projects/145f94a3de7b45258d4ec8687e488f38 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:28.902758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:28.904286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:28.922715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07219f-650b-4071-8dd0-42028db83aaf admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:29.016866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:29.016866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:29.016866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:29.016866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] PATH_INFO: `/v3/users/6d8707482cdb4540a8d40606c695fb1a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:29.017579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8707482cdb4540a8d40606c695fb1a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:29.019593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:29.260293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8707482cdb4540a8d40606c695fb1a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:29.261263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8707482cdb4540a8d40606c695fb1a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:29.289107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8707482cdb4540a8d40606c695fb1a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:29.317364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8707482cdb4540a8d40606c695fb1a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:29.318052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-916bf57e-7671-4788-bfb1-c7ac1ccee036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8707482cdb4540a8d40606c695fb1a'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:29.436713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1155/2278] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:28 2022] DELETE /identity/v3/users/6d8707482cdb4540a8d40606c695fb1a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:29.864561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:30.443996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:30.456439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:30.457970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:30.472896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e25b9-a5f6-4b41-8165-1a15cdae88e8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:30.575419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:30.576337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:30.576848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:30.577332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] PATH_INFO: `/v3/projects/fe68288103184d2eaa65c2586ce6884f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:30.578837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe68288103184d2eaa65c2586ce6884f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:30.580989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:30.795963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe68288103184d2eaa65c2586ce6884f', 'request_id': 'req-c23d7b57-4dac-461f-919b-d74b5724fb22'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:30.809133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe68288103184d2eaa65c2586ce6884f', 'request_id': 'req-c23d7b57-4dac-461f-919b-d74b5724fb22'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:30.880416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe68288103184d2eaa65c2586ce6884f', 'request_id': 'req-c23d7b57-4dac-461f-919b-d74b5724fb22'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:30.894546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] The token cache is being invalidate because project fe68288103184d2eaa65c2586ce6884f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:30.896232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:30.900665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-c23d7b57-4dac-461f-919b-d74b5724fb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:30.903205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1124/2279] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:30 2022] DELETE /identity/v3/projects/fe68288103184d2eaa65c2586ce6884f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:30.911404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:30.911686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:30.911961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:30.943145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:30.944811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:31.030550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1156/2280] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:31.040470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.064931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.064931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.085004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:31.086405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:31.100953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1125/2281] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:31.101712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.114716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6231b1-d02f-46df-9a60-c2f7fbe5652f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.122518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.123278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.123629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.123982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.124725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:31.125094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.127664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.144778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1157/2282] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:56:31.148221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.163879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81822a4d-c809-436c-aa0b-1b1d0c389a87 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.170078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.170818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.171197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.171836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.172579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.174609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.277461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.279699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:31.294700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815ce4-7401-4140-b2fc-40558a57f93a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.300950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.308192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.308192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.308192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] PATH_INFO: `/v3/users/7746eb3431c44b18a6b7ef3bdad13d6c` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.308192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7746eb3431c44b18a6b7ef3bdad13d6c)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.308192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.323977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1126/2283] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:31 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:31.325964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.470972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e4bac-9902-4c43-a117-e59515cdaca6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.479312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.479928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.480968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.481402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.490969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.490969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.607648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1127/2284] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:31 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:31.611048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.622152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7746eb3431c44b18a6b7ef3bdad13d6c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:31.622839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7746eb3431c44b18a6b7ef3bdad13d6c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:31.623812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ec1b-7feb-41b1-90b9-d41e9caee6e7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.627242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:31.631491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.632318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.632803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.633224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.634491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.638617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7746eb3431c44b18a6b7ef3bdad13d6c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:31.639216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.653710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1128/2285] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:31.658459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.676248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2d147-7dad-4bb4-88a6-68730ec5168f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.686365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7746eb3431c44b18a6b7ef3bdad13d6c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:31.687513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bf1e5a62-302b-4481-9e9f-fa462117d955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7746eb3431c44b18a6b7ef3bdad13d6c'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:31.694952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.697412 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.697629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.697897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.699255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.701051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.719966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1129/2286] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:31.726695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:31.729540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:31.751425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a339ec9-2d54-4381-a260-f4e8738d987e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:31.760297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:31.761023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.761352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.761632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] PATH_INFO: `/v3/projects/fa6900f5663a496db950dd1855fde5af/users/32d2c058e27542af9b90f09a356900dc/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.796894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6900f5663a496db950dd1855fde5af, user_id=32d2c058e27542af9b90f09a356900dc, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:31.800673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaff1a3-2587-4755-a7a2-7eefa04f6dc8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:31.806516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1158/2287] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:31 2022] DELETE /identity/v3/users/7746eb3431c44b18a6b7ef3bdad13d6c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:31.811279 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.811555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.811833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:31.866183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:31.872798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:31.909267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1130/2288] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:31 2022] PUT /identity/v3/projects/fa6900f5663a496db950dd1855fde5af/users/32d2c058e27542af9b90f09a356900dc/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:31.922534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:31.922897 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:31.923268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:32.002088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] MFA Rules not processed for user `32d2c058e27542af9b90f09a356900dc`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:32.003382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:32.052603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1159/2289] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:32.159775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:32.159775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:32.179070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1131/2290] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:32.180153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d5c0-6f5c-4da0-81f0-09d70bb7d78c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:32.180794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:32.187320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:32.287808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:32.288766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:32.289278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:32.289837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:32.339083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5abacb-b710-40e5-aa6b-637cc61376a1 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:32.344922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:32.345794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:32.346296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:32.346610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:32.361011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:32.363562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:32.379739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1132/2291] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:32.397782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:32.399533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36df14-92c6-497d-9bf7-a25f64b7187f service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:32.401566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:32.423930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc251-39ce-4df0-921b-d2dc8b75b0bc service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:32.425107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1160/2292] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:32.436798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:32.437602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:32.437958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:32.438306 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] PATH_INFO: `/v3/users/32d2c058e27542af9b90f09a356900dc` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:32.439578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d2c058e27542af9b90f09a356900dc)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:32.441970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:33.118509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d2c058e27542af9b90f09a356900dc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:33.119925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d2c058e27542af9b90f09a356900dc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:33.134900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d2c058e27542af9b90f09a356900dc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:33.136499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d2c058e27542af9b90f09a356900dc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:33.157494 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d2c058e27542af9b90f09a356900dc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:33.252729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1133/2293] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:32 2022] DELETE /identity/v3/users/32d2c058e27542af9b90f09a356900dc => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:33.257371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:33.257941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:33.257941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:33.281722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:33.282967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:33.360813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1161/2294] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:33.380548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:33.382433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:33.463543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:33.500398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde16f-cef7-4d2b-b5a9-cbb3f9cfd465 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:33.505352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:33.506116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:33.506501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:33.506877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:33.521199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:33.522688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:33.536975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1134/2295] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:33.875890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:33.877474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:33.892104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ee59d-bb3e-46a9-8912-f60829cb214c None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:33.901821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:33.902752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:33.903190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:33.903628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] PATH_INFO: `/v3/projects/7417f3d033ad4c208acb35be58b228c7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:33.904876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7417f3d033ad4c208acb35be58b228c7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:33.907233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.154756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:34.182018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7417f3d033ad4c208acb35be58b228c7', 'request_id': 'req-ad45013a-9113-4589-a61a-40e58707ac28'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.190064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7417f3d033ad4c208acb35be58b228c7', 'request_id': 'req-ad45013a-9113-4589-a61a-40e58707ac28'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.216619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.218143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.236241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a9fa-de86-42e5-b05a-a4a61304e684 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.315560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.316241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.316515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.316865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] PATH_INFO: `/v3/projects/fa6900f5663a496db950dd1855fde5af` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.318146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6900f5663a496db950dd1855fde5af)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.320970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.351753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7417f3d033ad4c208acb35be58b228c7', 'request_id': 'req-ad45013a-9113-4589-a61a-40e58707ac28'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.365942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] The token cache is being invalidate because project 7417f3d033ad4c208acb35be58b228c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:34.366271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.366932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ad45013a-9113-4589-a61a-40e58707ac28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.368805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1162/2296] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:33 2022] DELETE /identity/v3/projects/7417f3d033ad4c208acb35be58b228c7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:34.373610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36ef6-b613-4175-89af-204751519f64 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.374065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36ef6-b613-4175-89af-204751519f64 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.374372 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36ef6-b613-4175-89af-204751519f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.396152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-19d36ef6-b613-4175-89af-204751519f64 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:34.397480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-19d36ef6-b613-4175-89af-204751519f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.413498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1163/2297] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:34.416058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.416977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.417332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.439125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:34.440347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.448842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1164/2298] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:34.453047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.463849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a278c5f-6781-43fb-8e01-fb571a555f08 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.479263 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6900f5663a496db950dd1855fde5af', 'request_id': 'req-81c87704-2049-4636-a533-a408422ca5b2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.485438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6900f5663a496db950dd1855fde5af', 'request_id': 'req-81c87704-2049-4636-a533-a408422ca5b2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.529842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.530457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.530739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.531066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.531727 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:34.532030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.533722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.558173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1165/2299] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:56:34.559124 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.569565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c632f34-236e-4c07-9f5b-9dd767b9ed5a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.575632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.579854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.579854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.579854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.579854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.579854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.622553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6900f5663a496db950dd1855fde5af', 'request_id': 'req-81c87704-2049-4636-a533-a408422ca5b2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.638403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] The token cache is being invalidate because project fa6900f5663a496db950dd1855fde5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:34.639047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.639717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-81c87704-2049-4636-a533-a408422ca5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:34.641315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1135/2300] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:34 2022] DELETE /identity/v3/projects/fa6900f5663a496db950dd1855fde5af => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:34.654508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20180-4d82-45d2-94da-81b3929ce538 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.654508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20180-4d82-45d2-94da-81b3929ce538 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.654508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20180-4d82-45d2-94da-81b3929ce538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.669248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-fcc20180-4d82-45d2-94da-81b3929ce538 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:34.670506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fcc20180-4d82-45d2-94da-81b3929ce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.688044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1136/2301] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:34.690338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.690571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1166/2302] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/projects => generated 397 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:34.690682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.690912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.697900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.703221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.715311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:34.716868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:34.798786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1137/2303] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:34.803022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.809999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc318da-b8ff-4bfa-b520-42d135621ed7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.813849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617acbae-4470-4024-b2fa-9682b5f73e0d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.821394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.821394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.821394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.821394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.821883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.821883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.822027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.822121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.822402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.822696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.823407 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:56:34.823703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.825516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.853131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1138/2304] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:56:34.857455 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.867291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b266e-4966-4e48-a9a6-61b8ae7bdaa0 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.872859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.873448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.873726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.873992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.874624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.876542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:34.971827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1167/2305] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:34.975910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:34.987610 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a140-30fe-4f0d-9ecf-8470fdaf3f83 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:34.992559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:34.993288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:34.993566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:34.993839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:34.994506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:34.996121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.006271 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1168/2306] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:35.010702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.020800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b21c1-230d-4441-b224-b0e653c01593 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.027764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.036439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.036439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.036439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.036439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.036439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.045877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1169/2307] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:56:35.046075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1139/2308] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:34 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:56:35.046576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.049899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.059747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d8c-fd64-4979-bdf7-13d65eb789e2 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.129942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978580d-b9a8-4c55-917e-860585de84b8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.135160 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.137291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.137777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.138882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.139204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.139377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.139573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.139927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.140269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] PATH_INFO: `/v3/projects/e333c55c61964bf6b23ccc5badc1917a/users/543e7aeffb3c4779a1c979d1c65529b5/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.141531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.160208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e333c55c61964bf6b23ccc5badc1917a, user_id=543e7aeffb3c4779a1c979d1c65529b5, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.163369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0cb60-d086-43e0-8b29-8b1c3b309839 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.284247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1170/2309] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:35 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:35.294495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.309497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadfb9-2f15-4047-8279-db9d359f0341 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.310194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1140/2310] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:35 2022] PUT /identity/v3/projects/e333c55c61964bf6b23ccc5badc1917a/users/543e7aeffb3c4779a1c979d1c65529b5/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:35.321464 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.321899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.322235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.356128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] MFA Rules not processed for user `543e7aeffb3c4779a1c979d1c65529b5`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:35.357644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:35.404787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.405386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.405666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.406392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.407129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.409257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.422355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1171/2311] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:35.426120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.438932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5dc31-3217-417c-8802-9e7aafdff7d0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.441509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1141/2312] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:56:35.446853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.447259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.447984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.447984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.449187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.451728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.453486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.454912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:35.471021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1172/2313] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:35.472521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.484814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75b3c-246a-4f88-bac7-9e25f9a6eacc admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.490704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.491379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.491663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.491937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] PATH_INFO: `/v3/projects/7d5744ac93cb4c9f9588635e2440df0f/users/c5ee3184d47b4295b4ecac7ed72be2f0/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.518067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5744ac93cb4c9f9588635e2440df0f, user_id=c5ee3184d47b4295b4ecac7ed72be2f0, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.521722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.529547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4969e9-2483-4094-91a8-2ad7094220b3 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.537019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.540222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.540510 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.540960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.550393 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.551902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9d1b2-dae9-48ce-8514-18a40300009c service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.562488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1142/2314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:35.601506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1173/2315] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:35 2022] PUT /identity/v3/projects/7d5744ac93cb4c9f9588635e2440df0f/users/c5ee3184d47b4295b4ecac7ed72be2f0/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:35.611078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.611370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.611643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.651498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] MFA Rules not processed for user `c5ee3184d47b4295b4ecac7ed72be2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:35.653296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:35.745223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1143/2316] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:35.749943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:35.828063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:35.839276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5540c-20a4-440e-adef-c7b38e2f46bb admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:35.856086 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:35.857056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:35.857613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:35.858795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:35.859666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:35.863016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:35.984249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1174/2317] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:56:35 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:35.989250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.003273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14905b-36bf-43b3-94c8-37ab2ec8e9d7 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.072912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.073646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.074017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.074371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.075141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.077796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.252058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1144/2318] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:56:35 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:56:36.256401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.269043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb6590-7832-423f-912e-b30d674af82a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.273360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.275344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.275713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.275973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.276692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.278339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.297498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.301995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1175/2319] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:36.313190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd470-cf61-4b0b-a6b2-05c5217c7611 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.322469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.323188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.323473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.323752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] PATH_INFO: `/v3/projects/2585d6f956084fea9d5b08cd1029b9b3/users/8de749b1e0c4412fb78abd075d5d9db2/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.351760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2585d6f956084fea9d5b08cd1029b9b3, user_id=8de749b1e0c4412fb78abd075d5d9db2, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.355571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.469619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1145/2320] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:36 2022] PUT /identity/v3/projects/2585d6f956084fea9d5b08cd1029b9b3/users/8de749b1e0c4412fb78abd075d5d9db2/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:36.471102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.482573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b548ec-69b4-4a2a-9e4e-544d319a48ac admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.544866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.545133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.545548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.545830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.546484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.548154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae89c9-4305-4410-9041-90383d4fd21a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.561689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1176/2321] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:56:36.563096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.575677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298db9e-323e-401b-85ff-375dc58820f9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.590153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.590813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.591086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.591631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] PATH_INFO: `/v3/projects/2585d6f956084fea9d5b08cd1029b9b3/users/8de749b1e0c4412fb78abd075d5d9db2/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.594071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2585d6f956084fea9d5b08cd1029b9b3, user_id=8de749b1e0c4412fb78abd075d5d9db2, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.596836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.609905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1146/2322] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:56:36 2022] PUT /identity/v3/projects/2585d6f956084fea9d5b08cd1029b9b3/users/8de749b1e0c4412fb78abd075d5d9db2/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:36.620932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd4bf-9f9e-490f-8832-5446e4aa888d None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.621219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd4bf-9f9e-490f-8832-5446e4aa888d None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.621542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fd4bf-9f9e-490f-8832-5446e4aa888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.663684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-be7fd4bf-9f9e-490f-8832-5446e4aa888d None None] MFA Rules not processed for user `8de749b1e0c4412fb78abd075d5d9db2`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:36.666625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-be7fd4bf-9f9e-490f-8832-5446e4aa888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:36.759249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1177/2323] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:36.768880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:36.826237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ab95-6e29-453f-998c-b132dd4b84b1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:36.829957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:36.830577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:36.830846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:36.831113 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:36.901265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:36.902780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95601b92-77b8-4b94-af67-ae56e52949c0 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:36.912205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1147/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:37.208930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:37.594335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:40.388351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:40.449158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:42.408683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:42.409328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:42.409328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:42.411021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1178/2325] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:56:42.418039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998274d-20e2-40ff-bee5-2ba7df7c5abc None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:42.418646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998274d-20e2-40ff-bee5-2ba7df7c5abc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:42.418745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998274d-20e2-40ff-bee5-2ba7df7c5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:42.442828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2998274d-20e2-40ff-bee5-2ba7df7c5abc None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:42.444091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2998274d-20e2-40ff-bee5-2ba7df7c5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:42.457816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:42.539092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1148/2326] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:42.550333 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:42.551978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:42.610450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8c66b-29d9-484e-889c-61e83c6481b3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:42.614346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:42.617962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:42.617962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:42.617962 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:42.628072 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:42.629549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b299-8128-442b-8879-bfa322c52d73 service glance] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:42.641384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1179/2327] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:42.683948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:42.999556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b213-d418-4914-8124-53334b1830ff None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:42.999868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b213-d418-4914-8124-53334b1830ff None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.003246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0b213-d418-4914-8124-53334b1830ff None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.003246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1149/2328] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:56:43.006323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883153b4-edfd-4248-96e7-363d1d9fff17 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.006675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883153b4-edfd-4248-96e7-363d1d9fff17 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.007016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883153b4-edfd-4248-96e7-363d1d9fff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.027487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-883153b4-edfd-4248-96e7-363d1d9fff17 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:43.028719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-883153b4-edfd-4248-96e7-363d1d9fff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:43.089043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1180/2329] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:43.101427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0b213-d418-4914-8124-53334b1830ff None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:43.103646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-aea0b213-d418-4914-8124-53334b1830ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:43.118108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0b213-d418-4914-8124-53334b1830ff None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:43.121719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:43.122313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.122589 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.122858 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.129933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:43.131355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a363f37-15bb-4c55-b49d-39a13339746f service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:43.139010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1150/2330] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:43.252583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401ac9c-2f3a-4d1b-b3e1-d0fc08185e10 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.252892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401ac9c-2f3a-4d1b-b3e1-d0fc08185e10 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.253166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401ac9c-2f3a-4d1b-b3e1-d0fc08185e10 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.254535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1181/2331] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 10:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:56:43.260167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.260454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.260758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.283572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:43.284828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:43.294924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1151/2332] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:43.313923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401ac9c-2f3a-4d1b-b3e1-d0fc08185e10 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:43.332612 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401ac9c-2f3a-4d1b-b3e1-d0fc08185e10 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:43.337529 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:43.338353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.338551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.338828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.360009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:43.361584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fd47e-ad0c-4860-827a-9d34b09e8c35 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:43.373396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1182/2333] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:43.410360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:43.515815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e80f-77ad-4fb9-ad32-fe33b4b4c94d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:43.525539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:43.526352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:43.526735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:43.527179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] PATH_INFO: `/v3/users/c5ee3184d47b4295b4ecac7ed72be2f0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:43.530240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ee3184d47b4295b4ecac7ed72be2f0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:43.532377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:43.849349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ee3184d47b4295b4ecac7ed72be2f0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:43.850283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ee3184d47b4295b4ecac7ed72be2f0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:43.863270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ee3184d47b4295b4ecac7ed72be2f0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:43.864097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ee3184d47b4295b4ecac7ed72be2f0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:43.877279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ee3184d47b4295b4ecac7ed72be2f0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:43.937069 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:44.003941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1152/2334] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:43 2022] DELETE /identity/v3/users/c5ee3184d47b4295b4ecac7ed72be2f0 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:44.009060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:44.009710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:44.009710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:44.031887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:44.034189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:44.113356 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1183/2335] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:44.125538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:44.125538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:44.184442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f991ed-db2e-4f4e-bbd9-44302dd8f174 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:44.187993 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:44.188620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:44.188912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:44.189178 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:44.198874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:44.200346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:44.210229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1153/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:44.543542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:44.763983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:44.763983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:44.776385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7cfc-a25f-41db-93d2-c70cadbfd781 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:44.784154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:44.785126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:44.785464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:44.785938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] PATH_INFO: `/v3/projects/7d5744ac93cb4c9f9588635e2440df0f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:44.787297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5744ac93cb4c9f9588635e2440df0f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:44.789995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:44.932357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5744ac93cb4c9f9588635e2440df0f', 'request_id': 'req-2836f461-ee15-4e9e-bae0-71cd70ee6452'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:44.947198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5744ac93cb4c9f9588635e2440df0f', 'request_id': 'req-2836f461-ee15-4e9e-bae0-71cd70ee6452'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.094830 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5744ac93cb4c9f9588635e2440df0f', 'request_id': 'req-2836f461-ee15-4e9e-bae0-71cd70ee6452'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.111999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] The token cache is being invalidate because project 7d5744ac93cb4c9f9588635e2440df0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:45.112294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.113055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.114562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1184/2337] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:44 2022] DELETE /identity/v3/projects/7d5744ac93cb4c9f9588635e2440df0f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:45.119080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:45.129375 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd62001-ab3a-4db2-8077-deef22110485 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:45.192119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:45.193931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:45.247363 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:45.248016 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:45.248301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:45.248574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] PATH_INFO: `/v3/users/8de749b1e0c4412fb78abd075d5d9db2` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:45.250449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de749b1e0c4412fb78abd075d5d9db2)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:45.252462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:45.278097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836f461-ee15-4e9e-bae0-71cd70ee6452 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:45.284515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:45.285481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:45.286126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:45.286544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:45.289178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:45.354593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:45.356080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:45.365602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1185/2338] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:56:45.483538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:45.485312 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:45.499570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8d8f-44d8-4c52-aae9-cf3524f8ebe0 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:45.504318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:45.505635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:45.505920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:45.506202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] PATH_INFO: `/v3/users/543e7aeffb3c4779a1c979d1c65529b5` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:45.507358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=543e7aeffb3c4779a1c979d1c65529b5)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:45.509918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:45.534926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de749b1e0c4412fb78abd075d5d9db2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.535728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de749b1e0c4412fb78abd075d5d9db2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.544245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de749b1e0c4412fb78abd075d5d9db2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.545236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de749b1e0c4412fb78abd075d5d9db2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.560881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-739dbcbe-972b-4b8d-8451-d1a6c0353c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de749b1e0c4412fb78abd075d5d9db2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.664674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1154/2339] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:45 2022] DELETE /identity/v3/users/8de749b1e0c4412fb78abd075d5d9db2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:45.691572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:45.809204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543e7aeffb3c4779a1c979d1c65529b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.809204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543e7aeffb3c4779a1c979d1c65529b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.815200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543e7aeffb3c4779a1c979d1c65529b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.831766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543e7aeffb3c4779a1c979d1c65529b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.832808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543e7aeffb3c4779a1c979d1c65529b5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:45.960863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1186/2340] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:56:45 2022] DELETE /identity/v3/users/543e7aeffb3c4779a1c979d1c65529b5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:56:45.965854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:45.966140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:45.966418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:45.997224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:45.998467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:46.105843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1155/2341] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:46.120868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:46.122497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:46.207195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02d404-75ba-48bf-a8b4-f0a52f5daa1f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:46.212993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:46.213977 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:46.214410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:46.216159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:46.241792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:46.243888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:46.273935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1187/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:46.368298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:46.368298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:46.380509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda681db-fcbf-4ea1-9e2c-71fc3404acbd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:46.387725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:46.388723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:46.389214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:46.389690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] PATH_INFO: `/v3/projects/2585d6f956084fea9d5b08cd1029b9b3` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:46.391202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2585d6f956084fea9d5b08cd1029b9b3)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:46.393554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:46.520520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:46.522235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:46.630715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e10554-7700-4b21-9247-c4042382cf8e service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:46.645235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:46.652770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:46.652770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:46.652770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:46.652770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:46.671318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:46.671459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2585d6f956084fea9d5b08cd1029b9b3', 'request_id': 'req-b16dc4a1-a67e-4197-bcbd-5c890d48b780'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:46.673747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:46.680507 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2585d6f956084fea9d5b08cd1029b9b3', 'request_id': 'req-b16dc4a1-a67e-4197-bcbd-5c890d48b780'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:46.691994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1188/2343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:56:46.723663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:46.817147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2585d6f956084fea9d5b08cd1029b9b3', 'request_id': 'req-b16dc4a1-a67e-4197-bcbd-5c890d48b780'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:46.838711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] The token cache is being invalidate because project 2585d6f956084fea9d5b08cd1029b9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:46.839196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:46.842062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b16dc4a1-a67e-4197-bcbd-5c890d48b780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:46.845156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1156/2344] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:46 2022] DELETE /identity/v3/projects/2585d6f956084fea9d5b08cd1029b9b3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:47.128244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:47.130720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:47.161708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d64aa-bce9-4a55-863a-7dda671cf186 service placement] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:47.255438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:47.256466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:47.256774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:47.257043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] PATH_INFO: `/v3/projects/e333c55c61964bf6b23ccc5badc1917a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:47.258676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e333c55c61964bf6b23ccc5badc1917a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:47.260634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:47.435804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e333c55c61964bf6b23ccc5badc1917a', 'request_id': 'req-6a6c20e2-49de-4be4-83a3-05b13b031ca8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:47.441263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e333c55c61964bf6b23ccc5badc1917a', 'request_id': 'req-6a6c20e2-49de-4be4-83a3-05b13b031ca8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:47.594169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e333c55c61964bf6b23ccc5badc1917a', 'request_id': 'req-6a6c20e2-49de-4be4-83a3-05b13b031ca8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:47.607430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] The token cache is being invalidate because project e333c55c61964bf6b23ccc5badc1917a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:56:47.608015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:47.608899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:56:47.611618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1189/2345] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:56:47 2022] DELETE /identity/v3/projects/e333c55c61964bf6b23ccc5badc1917a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:56:48.123472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:48.834291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:49.120713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:50.093108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:50.646091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:51.394394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:52.079430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c78d7-50ba-4a51-a265-4db1ac7965bf None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:52.080244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c78d7-50ba-4a51-a265-4db1ac7965bf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:52.080525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c78d7-50ba-4a51-a265-4db1ac7965bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:52.102224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-115c78d7-50ba-4a51-a265-4db1ac7965bf None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:52.103594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-115c78d7-50ba-4a51-a265-4db1ac7965bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:52.129083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:52.166254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1157/2346] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:52.192932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:52.196404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:52.206424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:52.273917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c20e2-49de-4be4-83a3-05b13b031ca8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:52.279004 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:52.286159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:52.286159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:52.286159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:52.290816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:52.294378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:52.325955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1190/2347] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:56:52.488062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603174-7f9c-4213-9b83-2085668dae38 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:52.488575 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603174-7f9c-4213-9b83-2085668dae38 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:52.489009 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603174-7f9c-4213-9b83-2085668dae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:52.530710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-dc603174-7f9c-4213-9b83-2085668dae38 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:52.532055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dc603174-7f9c-4213-9b83-2085668dae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:52.542233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1158/2348] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:52.558029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:52.575593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bbf9-0341-4020-ae37-9558bf3c2203 service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:52.584156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:52.585661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:52.587088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:52.588221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:52.600163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:52.603888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:52.630793 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1191/2349] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:56:53.394262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:54.052022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354223-ee00-44a0-843b-190c2be5bfa9 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:54.052522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354223-ee00-44a0-843b-190c2be5bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:54.052642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354223-ee00-44a0-843b-190c2be5bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:54.074334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-68354223-ee00-44a0-843b-190c2be5bfa9 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:54.075620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-68354223-ee00-44a0-843b-190c2be5bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:54.083295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1159/2350] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 10:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:54.105634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:54.120049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055a1c-e8e5-4208-b34f-ee90960db92a service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:54.125253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:54.125879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:54.126183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:54.126479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:54.135722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:54.137507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:54.146711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1192/2351] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:56:54.174913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:54.987355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e29-15d6-42db-b5dc-24208ca8c1c1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:54.987717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e29-15d6-42db-b5dc-24208ca8c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:54.988068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27e29-15d6-42db-b5dc-24208ca8c1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:55.008581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:56:55.020098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-26c27e29-15d6-42db-b5dc-24208ca8c1c1 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:55.021590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-26c27e29-15d6-42db-b5dc-24208ca8c1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:55.031978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1160/2352] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:55.044996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:55.057026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57917f9b-3e10-4904-a299-747c4833abd5 service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:55.062636 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:55.063332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:55.063665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:55.063942 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:55.073894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:55.075718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:55.087837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1193/2353] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:56:55.980067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:55.980555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:55.980677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:56.001699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:56:56.006722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:56:56.011025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1161/2354] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 10:56:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:56:56.023028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:56:56.034213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb914-22bd-45e2-bace-55519c97568a service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:56:56.039619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:56:56.040349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:56:56.040664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:56:56.040938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:56:56.049211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:56:56.050828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830fe1-4c7f-4dc5-ac36-12287b21a9d2 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:56:56.060038 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1194/2355] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:56:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:57:01.006389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:01.009062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:01.101036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6319d-1c47-4d1f-b9df-fd3b1917753f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:01.106141 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:01.106800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:01.107074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:01.107476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] PATH_INFO: `/v3/users/a2bdfcb2c7fc41678f03655705a365b0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:01.108648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bdfcb2c7fc41678f03655705a365b0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:01.110610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:01.345980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bdfcb2c7fc41678f03655705a365b0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:01.346885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bdfcb2c7fc41678f03655705a365b0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:01.355373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bdfcb2c7fc41678f03655705a365b0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:01.356193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bdfcb2c7fc41678f03655705a365b0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:01.370647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bdfcb2c7fc41678f03655705a365b0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:01.475191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1162/2356] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:57:01 2022] DELETE /identity/v3/users/a2bdfcb2c7fc41678f03655705a365b0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:57:01.480216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:01.485496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:01.485496 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:01.503415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:01.504760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:01.579868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1195/2357] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:01.591213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:01.592679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:01.662042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec490a0-86c1-4aa2-89fd-d98c8f987490 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:01.666169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:01.666774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:01.667051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:01.667319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:01.676719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:01.678366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605eab8-d523-43cf-8b64-02636fc37bdc service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:01.689803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1163/2358] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:57:01.978644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:01.980142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:01.994329 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49742c8-0fba-4919-8d73-52571972c2db None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:01.999405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.000039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.000318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.000619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] PATH_INFO: `/v3/projects/297ecde5866e4d59a15299ec9df9e728` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.001748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297ecde5866e4d59a15299ec9df9e728)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.003725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.197805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297ecde5866e4d59a15299ec9df9e728', 'request_id': 'req-db73ce9a-ed4d-484c-b242-76d0c615a176'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:02.211367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297ecde5866e4d59a15299ec9df9e728', 'request_id': 'req-db73ce9a-ed4d-484c-b242-76d0c615a176'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:02.285784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297ecde5866e4d59a15299ec9df9e728', 'request_id': 'req-db73ce9a-ed4d-484c-b242-76d0c615a176'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:02.300061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] The token cache is being invalidate because project 297ecde5866e4d59a15299ec9df9e728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:57:02.300665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:02.301520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-db73ce9a-ed4d-484c-b242-76d0c615a176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:57:02.303085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1196/2359] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:57:01 2022] DELETE /identity/v3/projects/297ecde5866e4d59a15299ec9df9e728 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:57:02.309007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.314237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.314237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.347350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:02.348749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:02.361828 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:57:02.437342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1164/2360] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:02.439633 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.439919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.440391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.465750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:02.465750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:02.472445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1197/2361] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:02.477168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.491513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12220-c34a-4c20-a63c-631f74197f0f None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.497334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.498687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.498982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.499435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.500087 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:57:02.500384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.502155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.515613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1165/2362] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:57:02.520348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.532250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bc7ae-4a98-469b-9fb6-d26a500510c7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.537415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.542785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.542785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.542785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.542785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.542785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.655131 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1198/2363] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:57:02 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:57:02.658628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.669657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a6bcb-95ca-467d-9513-1924876f0671 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.728394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.729044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.729322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.729591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.730211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.732142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.840366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1166/2364] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:57:02 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:57:02.844563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.855659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbe2e-818c-491d-9944-32f9cd951c48 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.860269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.860893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.861170 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.861436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.862068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.863709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.874003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1199/2365] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:57:02.878161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.888461 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b679d-4fe6-4ddb-bba4-c7d6d109d874 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.893220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.893821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.894099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.894373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.895012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.896605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff25ef-864c-449b-81b8-9aee73d3d1d2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:02.907830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1167/2366] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:57:02.912326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:02.919476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:57:02.923212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af95ab-092f-413c-afcd-194cf80a9690 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:02.927914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:02.928553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:02.928865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:02.929132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] PATH_INFO: `/v3/projects/4f1d9aefea6542a7b524f367a4cc9d84/users/2b2a09149561465799af85ae6bec7b12/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:02.943321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1d9aefea6542a7b524f367a4cc9d84, user_id=2b2a09149561465799af85ae6bec7b12, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:02.946288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:03.086949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1200/2367] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:57:02 2022] PUT /identity/v3/projects/4f1d9aefea6542a7b524f367a4cc9d84/users/2b2a09149561465799af85ae6bec7b12/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:57:03.091913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb8f-5dc9-4ff1-b977-ee426c093ffd None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:03.092248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb8f-5dc9-4ff1-b977-ee426c093ffd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:03.092524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bb8f-5dc9-4ff1-b977-ee426c093ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:03.112232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-52b7bb8f-5dc9-4ff1-b977-ee426c093ffd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:03.113558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-52b7bb8f-5dc9-4ff1-b977-ee426c093ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:03.178054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1168/2368] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:03.187861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:03.189570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:03.250181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c08a2-299f-4012-a8e6-df7e198ddc23 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:03.253907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:03.254506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:03.254855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:03.255127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:03.264754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:03.266198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:03.276101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1201/2369] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:57:04.636077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3820e-08e0-452a-92eb-ba75f85deca6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:04.637364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3820e-08e0-452a-92eb-ba75f85deca6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:04.637364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3820e-08e0-452a-92eb-ba75f85deca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:04.667135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-09c3820e-08e0-452a-92eb-ba75f85deca6 None None] MFA Rules not processed for user `2b2a09149561465799af85ae6bec7b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:04.668371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-09c3820e-08e0-452a-92eb-ba75f85deca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:04.677851 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:57:04.737595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1169/2370] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:04.749432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:04.750912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:04.820903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd225-5f33-482b-9ba6-748f77a0d341 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:04.825034 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:04.825742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:04.826122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:04.826657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:04.836224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:04.837784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005669e4-b2e9-4aeb-9aef-b5cf001e4c74 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:04.847395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1202/2371] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:57:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:57:06.684868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:06.685392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:06.685392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:06.704217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] MFA Rules not processed for user `2b2a09149561465799af85ae6bec7b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:06.705451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:06.713173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1170/2372] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:14.727100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a629-689c-4a2b-99e5-1eee57e5aca3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:14.727614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a629-689c-4a2b-99e5-1eee57e5aca3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:14.727614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a629-689c-4a2b-99e5-1eee57e5aca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:14.748376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9dd7a629-689c-4a2b-99e5-1eee57e5aca3 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:14.749628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9dd7a629-689c-4a2b-99e5-1eee57e5aca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:14.811492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1203/2373] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 10:57:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:14.823472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:57:14.824880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:14.893707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18ce37-e66a-4324-a42f-0661fc8d8d14 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:57:14.899312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:57:14.899915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:14.900191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:14.900462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:14.908279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:57:14.909916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f33a4-b6ba-476d-b452-59db3e0e2532 service swift] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:57:14.918621 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1171/2374] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:57:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:57:24.805016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:57:24.915414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=57 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:57:37.636874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d492bf-5081-42e8-8736-70a1e48b396a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:57:37.637454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d492bf-5081-42e8-8736-70a1e48b396a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:57:37.637454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d492bf-5081-42e8-8736-70a1e48b396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:57:37.657353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-48d492bf-5081-42e8-8736-70a1e48b396a None None] MFA Rules not processed for user `60c731fa91114cbebe4754e6e26ab756`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:57:37.658696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-48d492bf-5081-42e8-8736-70a1e48b396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:57:37.718213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1204/2375] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:57:47.710652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=25 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:15.752623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eba6c-5feb-4fc4-98fe-329779294fda None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:15.753156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eba6c-5feb-4fc4-98fe-329779294fda None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:15.753269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eba6c-5feb-4fc4-98fe-329779294fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:15.773658 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8b4eba6c-5feb-4fc4-98fe-329779294fda None None] MFA Rules not processed for user `76d057c5f1ca479d87271cc0ed710c12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:58:15.774954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8b4eba6c-5feb-4fc4-98fe-329779294fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:15.835181 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1172/2376] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:58:20.546906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:20.547428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:20.547428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:20.568074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] MFA Rules not processed for user `aa80a09a986646ab98a5cfdac813bd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:58:20.569337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:20.622840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1205/2377] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:58:25.827989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=25 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:28.470139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfb39-550e-4ce5-b04b-52310ba4c95e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:28.471078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfb39-550e-4ce5-b04b-52310ba4c95e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:28.471523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dfb39-550e-4ce5-b04b-52310ba4c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:28.493911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-312dfb39-550e-4ce5-b04b-52310ba4c95e None None] MFA Rules not processed for user `2b2a09149561465799af85ae6bec7b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:58:28.495139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-312dfb39-550e-4ce5-b04b-52310ba4c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:28.502617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1173/2378] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:58:30.616231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=25 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:34.756677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:34.766259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f188-8738-48a7-80a4-32db75b960c6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:34.770028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:34.771381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:34.771663 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:34.771931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:34.774050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:34.863254 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:34.865407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:34.877616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1206/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:58:35.687508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:35.688023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:35.688023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:35.707300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:58:35.708938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:35.716911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1174/2380] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:58:35.970416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:35.982699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f6d0-6ac8-4796-b72b-be1f4c5af3e9 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:35.987712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:35.988317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:35.988637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:35.988978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:35.998022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:35.999809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:36.017234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1207/2381] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:58:37.287521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:37.288989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:37.300863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c0486-7427-4ce0-89eb-e319b8a16f5b None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:37.306034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:37.306551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:37.306894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:37.307089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:37.308868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:37.323579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:37.325039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:37.337943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1175/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:58:46.005763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:46.007515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:46.009021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=40 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:46.024558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621cdd7-fb21-4c5a-a505-d077e93f2c8a service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:46.029386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:46.030199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:46.030627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:46.031058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] PATH_INFO: `/v3/users/406440356a1544f0920b59616e774d75` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:46.033137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406440356a1544f0920b59616e774d75)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:46.036156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:46.302596 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406440356a1544f0920b59616e774d75'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.303482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406440356a1544f0920b59616e774d75'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.311355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406440356a1544f0920b59616e774d75'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.323917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406440356a1544f0920b59616e774d75'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.324660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406440356a1544f0920b59616e774d75'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.464945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1208/2383] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:58:46 2022] DELETE /identity/v3/users/406440356a1544f0920b59616e774d75 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:58:46.743885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:46.755377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1697-9448-4fa0-996f-669f300618d2 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:46.822136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:46.822553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:46.822833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:46.823104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] PATH_INFO: `/v3/projects/18d48205d9c9429b8824e235d3bd2565` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:46.824298 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d48205d9c9429b8824e235d3bd2565)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:46.826256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:46.980968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d48205d9c9429b8824e235d3bd2565', 'request_id': 'req-97b4f9c6-017d-4d86-8a5c-783d923fd073'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:46.986477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d48205d9c9429b8824e235d3bd2565', 'request_id': 'req-97b4f9c6-017d-4d86-8a5c-783d923fd073'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.084870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d48205d9c9429b8824e235d3bd2565', 'request_id': 'req-97b4f9c6-017d-4d86-8a5c-783d923fd073'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.096896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] The token cache is being invalidate because project 18d48205d9c9429b8824e235d3bd2565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:58:47.097203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.097873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.099532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1176/2384] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:58:46 2022] DELETE /identity/v3/projects/18d48205d9c9429b8824e235d3bd2565 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:58:47.103521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:47.104956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:47.118710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746937c4-9638-4ae4-9530-272ca45c8257 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:47.175033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:47.175653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:47.175921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:47.176751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] PATH_INFO: `/v3/users/5894f5698bd04431ae99eb287eb4cf4e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:47.177880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5894f5698bd04431ae99eb287eb4cf4e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:47.179794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:47.398899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5894f5698bd04431ae99eb287eb4cf4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.399549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5894f5698bd04431ae99eb287eb4cf4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.413328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5894f5698bd04431ae99eb287eb4cf4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.425258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5894f5698bd04431ae99eb287eb4cf4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.425953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5894f5698bd04431ae99eb287eb4cf4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:47.428192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:47.541775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1209/2385] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:58:47 2022] DELETE /identity/v3/users/5894f5698bd04431ae99eb287eb4cf4e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:58:47.789505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:47.791373 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:47.805475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4f9c6-017d-4d86-8a5c-783d923fd073 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:47.870542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:47.871098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:47.871381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:47.871664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] PATH_INFO: `/v3/projects/c3f8c835a04f40f28831f291f0a5fb27` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:47.872868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8c835a04f40f28831f291f0a5fb27)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:47.874890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:47.882563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:58:48.058032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8c835a04f40f28831f291f0a5fb27', 'request_id': 'req-20a48912-617d-4bd4-82df-1d102d9eb46d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:48.064401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8c835a04f40f28831f291f0a5fb27', 'request_id': 'req-20a48912-617d-4bd4-82df-1d102d9eb46d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:48.138943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8c835a04f40f28831f291f0a5fb27', 'request_id': 'req-20a48912-617d-4bd4-82df-1d102d9eb46d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:48.152958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] The token cache is being invalidate because project c3f8c835a04f40f28831f291f0a5fb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:58:48.153257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:48.154048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:58:48.155582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1177/2386] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:58:47 2022] DELETE /identity/v3/projects/c3f8c835a04f40f28831f291f0a5fb27 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:58:50.103199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:50.104621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:50.159704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64d649-3bc3-4121-bcb2-c4299d96a049 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:50.208661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:50.209182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:50.209461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:50.209729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:50.211453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:50.269140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:50.271507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbe5db-3c02-4abc-99ae-32c62414225e service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:50.280580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1210/2387] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:58:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:58:57.594642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:58:57.596026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:57.608067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a48912-617d-4bd4-82df-1d102d9eb46d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:58:57.611572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:58:57.612156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:58:57.612427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:58:57.612797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:58:57.615036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:58:57.673576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:58:57.675017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:58:57.684708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1178/2388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:00.276365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=70 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:07.680532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:18.474391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:18.474862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:18.474975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:18.495936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] MFA Rules not processed for user `60c731fa91114cbebe4754e6e26ab756`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:18.497193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:18.504882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1211/2389] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:18.819694 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:18.821247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:18.883066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff06d-fa35-43ad-b39e-0e94f0973a40 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:18.888581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:18.889217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:18.889496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:18.889768 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:18.891548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:18.903016 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:18.904548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:18.912979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1179/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:19.523208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:19.524765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:19.643510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fe842-6b51-49c3-8c47-20218d3f54a7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:19.654439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:19.655054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:19.655537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:19.655828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:19.657747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:19.670539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:19.672185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:19.684543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1212/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:19.701969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:19.703516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:19.789965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ae2a4-accd-417b-aa1e-a983229aa50d service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:19.795905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:19.796450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:19.796814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:19.797130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:19.798878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:19.812142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:19.813770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:19.826019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1180/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:24.216709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:24.226229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083b5c8-1662-4bf8-b727-e9c13b8e06f2 service placement] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:24.229810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:24.230546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:24.234858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:24.234858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:24.234858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:24.242648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:24.244067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:24.251841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1213/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:27.647254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:27.648827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:27.662887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054ee6-6ab8-4095-be8c-90d8f75ec43b service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:27.668384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:27.669073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:27.669280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:27.669549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:27.671334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:27.728767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:27.730325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:27.739734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1181/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:31.921383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:31.931017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6d705-dba0-4c45-a5c0-536c127d0e4c service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:31.934642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:31.935230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:31.935507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:31.935775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:31.942898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:32.008506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:32.009998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:32.020367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1214/2395] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:59:35.994488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:35.995938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:36.010488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc74014-ad04-4a06-99a2-0a767f9a7621 service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:36.015493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:36.016098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:36.016378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:36.016693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:36.018876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:36.030653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:36.032226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:36.043261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1182/2396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:36.185394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:36.191369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:36.199772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f576-ec8e-417d-8ad1-12cd7bec8233 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:36.204688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:36.205324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:36.205611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:36.205890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] PATH_INFO: `/v3/users/76d057c5f1ca479d87271cc0ed710c12` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:36.207022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d057c5f1ca479d87271cc0ed710c12)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:36.208996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:36.417704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d057c5f1ca479d87271cc0ed710c12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:36.418364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d057c5f1ca479d87271cc0ed710c12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:36.425839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d057c5f1ca479d87271cc0ed710c12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:36.427702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:36.437824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d057c5f1ca479d87271cc0ed710c12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:36.443385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bfc40c26-9567-4f3e-ac69-afc815a09fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d057c5f1ca479d87271cc0ed710c12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:36.538622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1215/2397] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:59:36 2022] DELETE /identity/v3/users/76d057c5f1ca479d87271cc0ed710c12 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:36.814071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:36.825481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9db8-dc94-495c-aa8c-882f48ec73df service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:36.835272 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:36.884165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:36.884913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:36.887491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:36.887491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] PATH_INFO: `/v3/projects/791397adb8c24e47a16ee8ef0c905373` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:36.887491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791397adb8c24e47a16ee8ef0c905373)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:36.888609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.055701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791397adb8c24e47a16ee8ef0c905373', 'request_id': 'req-7d657f09-2f60-403e-b995-f93e5cc5ec42'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:37.061084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791397adb8c24e47a16ee8ef0c905373', 'request_id': 'req-7d657f09-2f60-403e-b995-f93e5cc5ec42'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:37.158447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791397adb8c24e47a16ee8ef0c905373', 'request_id': 'req-7d657f09-2f60-403e-b995-f93e5cc5ec42'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:37.173075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] The token cache is being invalidate because project 791397adb8c24e47a16ee8ef0c905373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:59:37.173443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:37.174168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:37.176563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1183/2398] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:59:36 2022] DELETE /identity/v3/projects/791397adb8c24e47a16ee8ef0c905373 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:37.181406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322116-3043-4439-88de-e3d15ebc982b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.185918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322116-3043-4439-88de-e3d15ebc982b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.185918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322116-3043-4439-88de-e3d15ebc982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.193860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.196643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:37.204225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-86322116-3043-4439-88de-e3d15ebc982b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:37.205857 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-86322116-3043-4439-88de-e3d15ebc982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:37.284253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d657f09-2f60-403e-b995-f93e5cc5ec42 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.287129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1216/2399] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:37.289879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.290491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.290771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.291045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.292818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:37.294838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.295198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.295537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.307107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.308734 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.315711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:37.316970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:37.320212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1184/2400] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:37.324876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1217/2401] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:37.329284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.340930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007ef7-7fe6-45f3-be76-2c69b5fc7699 service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.347435 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.348044 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.348322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.348617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.349265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:59:37.349564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.351260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.365733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1185/2402] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:59:37.369833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.379508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6c891-1e4f-4860-9abc-c6035c344372 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.384444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.386309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.386309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.386309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.386309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.388246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.534021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1218/2403] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:37 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:37.538522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.548974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdac93-c82f-4aea-9055-57f918be3684 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.560927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:37.605142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.605740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.606015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.606284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.606914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.608927 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.706711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1186/2404] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:37 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:37.713425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.718983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a285e-26f8-4652-9dbc-9e3c419dbfb2 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.724334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.724970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.725246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.725518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.726152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.727764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.738800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1219/2405] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:37.742819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.753402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da95d-13c4-48a7-b352-cd643a9feb20 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.758554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.759248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.759470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.759745 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.760394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.762051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbede378-b0a5-4f27-a072-cb0630e504d6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.774479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1187/2406] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:37.778648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:37.789776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23653480-9e1f-465f-94b1-3177f2e5d4e2 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:37.794780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:37.795432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.795707 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.795975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] PATH_INFO: `/v3/projects/f6c41286ed5b46e4b21c9a9ee0114b24/users/31c1a72b0bba471babfae0c070c3e11d/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.811206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c41286ed5b46e4b21c9a9ee0114b24, user_id=31c1a72b0bba471babfae0c070c3e11d, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:37.814056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:37.887212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1220/2407] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:37 2022] PUT /identity/v3/projects/f6c41286ed5b46e4b21c9a9ee0114b24/users/31c1a72b0bba471babfae0c070c3e11d/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:59:37.899982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:37.900270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:37.900759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:37.930447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] MFA Rules not processed for user `31c1a72b0bba471babfae0c070c3e11d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:37.931688 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:38.004338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1188/2408] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:38.015647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:38.088401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2addd-b7b7-4b57-aff7-fa5e7cca9b52 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:38.094011 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:38.094615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:38.094897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:38.095173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:38.103146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:38.104786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:38.108205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:38.114571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1221/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:41.975283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:41.988946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a3f3-8147-4851-9385-cfa42134330d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:41.995593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:41.996271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:41.996642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:41.996923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:41.998643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:42.011756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:42.018520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5acb43-a4be-47dc-a5b0-13569c150420 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:42.028789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1189/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:47.779115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:47.839875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d1b-edbd-4fa5-98f8-d6c4e78837c1 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:47.844365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:47.845059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:47.845334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:47.845603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] PATH_INFO: `/v3/users/31c1a72b0bba471babfae0c070c3e11d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:47.847054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c1a72b0bba471babfae0c070c3e11d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:47.849061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:48.089700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c1a72b0bba471babfae0c070c3e11d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:48.089869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c1a72b0bba471babfae0c070c3e11d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:48.097264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c1a72b0bba471babfae0c070c3e11d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:48.109240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c1a72b0bba471babfae0c070c3e11d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:48.109956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c1a72b0bba471babfae0c070c3e11d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:48.229563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1222/2411] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:59:47 2022] DELETE /identity/v3/users/31c1a72b0bba471babfae0c070c3e11d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:48.234161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:48.234624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:48.234737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:48.256876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:48.258089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:48.317193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1190/2412] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:48.326905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:48.328335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:48.388910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871094e3-3552-42e9-9bee-8be6a96789fe admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:48.392758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:48.393688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:48.394411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:48.394695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:48.406504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:48.407972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab982ff4-bab5-428f-b631-1c5e67f8c4b2 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:48.419535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1223/2413] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:48.954540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:48.958995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:48.972653 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155735f4-1b19-416d-ae99-38fdb5225c25 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:48.984537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:48.985246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:48.985547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:48.985821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] PATH_INFO: `/v3/projects/f6c41286ed5b46e4b21c9a9ee0114b24` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:48.987681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c41286ed5b46e4b21c9a9ee0114b24)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:48.989722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:48.998791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:49.013954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.014581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.014581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.035979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:49.037656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:49.052239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:49.101236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1224/2414] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:49.150198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c41286ed5b46e4b21c9a9ee0114b24', 'request_id': 'req-52528f72-f23d-4cb7-99b9-11a8314eb55e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:49.156582 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c41286ed5b46e4b21c9a9ee0114b24', 'request_id': 'req-52528f72-f23d-4cb7-99b9-11a8314eb55e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:49.258157 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c41286ed5b46e4b21c9a9ee0114b24', 'request_id': 'req-52528f72-f23d-4cb7-99b9-11a8314eb55e'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:49.273346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] The token cache is being invalidate because project f6c41286ed5b46e4b21c9a9ee0114b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:59:49.273346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:49.273346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-52528f72-f23d-4cb7-99b9-11a8314eb55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:49.275464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:49.275707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1191/2415] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:59:48 2022] DELETE /identity/v3/projects/f6c41286ed5b46e4b21c9a9ee0114b24 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:49.277404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:49.280662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69766-b306-4a96-ac6e-2ea90db92174 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.280960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69766-b306-4a96-ac6e-2ea90db92174 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.281252 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69766-b306-4a96-ac6e-2ea90db92174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.302817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e2b69766-b306-4a96-ac6e-2ea90db92174 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:49.304280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e2b69766-b306-4a96-ac6e-2ea90db92174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:49.366643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2608d-3f1a-46aa-bc69-c7de5156cd40 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:49.400730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1192/2416] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:49.409213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.409506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.409792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.431885 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:49.433153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:49.434829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:49.435443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.435723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.435993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.437870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:49.443539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1193/2417] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:49.447805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:49.457960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080add-757f-405c-84b0-a873a8ffe756 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:49.463021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:49.463652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.463911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.464177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.464848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:59:49.465292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:49.466875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:49.480067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1194/2418] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:59:49.484753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:49.494702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258ba58-9cdc-4812-bcfa-4b400bedd71e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:49.498726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:49.499534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:49.500120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.500337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:49.500437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.500696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.501321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:49.503421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:49.508666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1225/2419] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 10:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:59:49.675985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1195/2420] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:49 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:49.681678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:49.691641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6264-2bbc-47bf-be1e-53006ac9ad3b service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:49.697522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:49.773469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:49.774096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:49.774376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:49.774675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:49.775314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:49.777330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:49.976913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1226/2421] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:49 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:49.981572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:49.994803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61cc49-4573-48b7-bc6b-5d9e435e9d8f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.004552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.004552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.004552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.004552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.005027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.005818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.021384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1196/2422] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:50.022905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.037309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0e61-ee34-4b47-88a2-95b0fe9d344c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.044845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.045881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.046563 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.047044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.048140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.050651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36a59c-396d-4c34-9b35-65e3e735d779 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.069667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1227/2423] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:50.070564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.084558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d72cfb-5586-4dca-977a-568e8b0a670f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.091378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.092165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.092550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.092990 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] PATH_INFO: `/v3/projects/c6cf7624c58b46f1b780efb98327b51d/users/85c3912bcee347119939dbc79b2339b7/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.112997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cf7624c58b46f1b780efb98327b51d, user_id=85c3912bcee347119939dbc79b2339b7, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.115682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.245479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1197/2424] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:50 2022] PUT /identity/v3/projects/c6cf7624c58b46f1b780efb98327b51d/users/85c3912bcee347119939dbc79b2339b7/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:50.258148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.258708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.259150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.296659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] MFA Rules not processed for user `85c3912bcee347119939dbc79b2339b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:50.297972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:50.395389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.397530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1228/2425] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:50.427503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:50.485755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce183e-c0db-4d52-8441-00fd66f20bf9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.496957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.500623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.500623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.500623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.500623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.506397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.653051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1198/2426] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:50 2022] POST /identity/v3/projects => generated 405 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:50.654357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.671929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c7d78-5de2-4244-90e8-9f4f91260b19 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.746148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.746775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.747052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.747308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.747939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.750125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.899832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1229/2427] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:50 2022] POST /identity/v3/users => generated 309 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:50.904391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.934986 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98924ed7-1fd6-4605-8f89-64c91cfd7082 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:50.952355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:50.958290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:50.958290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:50.958290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:50.958290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:50.959150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:50.975086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1199/2428] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:50.979366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:50.994621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772e47-23b3-4bf2-956f-e20e59fbd12a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:51.001033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:51.002069 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.002319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.004837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] PATH_INFO: `/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26/users/4542cecc6a0549b5a28ffed4cdeb37af/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.007768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:51.025905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27abbdfc8be74c4e9c7f5731cb8a5e26, user_id=4542cecc6a0549b5a28ffed4cdeb37af, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:51.029811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:51.121569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1230/2429] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:50 2022] PUT /identity/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26/users/4542cecc6a0549b5a28ffed4cdeb37af/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:51.125276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:51.140400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb685d3-f03f-4134-98a6-360d588ac404 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:51.208500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:51.209301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.209682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.210030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.210760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:51.212421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5905be-9b0d-4177-a296-9e5718bcc840 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:51.227670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1200/2430] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:51.230741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:51.242690 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41fe-3887-4904-9db9-9f5abb67555e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:51.247931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:51.248666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.249019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.249367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] PATH_INFO: `/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26/users/4542cecc6a0549b5a28ffed4cdeb37af/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.251776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27abbdfc8be74c4e9c7f5731cb8a5e26, user_id=4542cecc6a0549b5a28ffed4cdeb37af, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:51.256110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:51.271257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1231/2431] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:51 2022] PUT /identity/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26/users/4542cecc6a0549b5a28ffed4cdeb37af/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:59:51.281788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.282078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.282359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.315953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] MFA Rules not processed for user `4542cecc6a0549b5a28ffed4cdeb37af`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:51.317241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:51.405197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1201/2432] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:51.418172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:51.420055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:51.497515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c03a9d-8d6c-4641-9609-1be53a202a8b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:51.501650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:51.502855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.503359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.503825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.516805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:51.518841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab5973-9809-42e1-a739-388b0209fb38 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:51.531512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1232/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:51.687896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:51.704116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:51.759073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca14e7-1ac5-4489-8df1-4e7a08408bcf None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:51.763838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:51.764567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:51.764971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:51.765341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] PATH_INFO: `/v3/users/85c3912bcee347119939dbc79b2339b7` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:51.766564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c3912bcee347119939dbc79b2339b7)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:51.769199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:52.012219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c3912bcee347119939dbc79b2339b7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:52.013045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c3912bcee347119939dbc79b2339b7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:52.032522 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c3912bcee347119939dbc79b2339b7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:52.036385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c3912bcee347119939dbc79b2339b7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:52.075929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c3912bcee347119939dbc79b2339b7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:52.284690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1202/2434] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:59:51 2022] DELETE /identity/v3/users/85c3912bcee347119939dbc79b2339b7 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:52.287138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:52.287606 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:52.287709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:52.308376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:52.309928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:52.396906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1233/2435] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:52.406696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:52.408458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:52.482251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10ebf6-aee5-4484-a662-1352efe590de admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:52.487826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:52.488827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:52.489120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:52.489394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:52.500983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:52.503238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:52.521661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1203/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:53.144888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:53.146630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:53.182346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c3eec-a236-418a-b1a2-b09ab3fdb392 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:53.187114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:53.187756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:53.190162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:53.190162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] PATH_INFO: `/v3/projects/c6cf7624c58b46f1b780efb98327b51d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:53.190162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cf7624c58b46f1b780efb98327b51d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:53.192304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:53.372230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cf7624c58b46f1b780efb98327b51d', 'request_id': 'req-971ae521-5afb-4b77-878b-78cbf44aee6e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.385179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cf7624c58b46f1b780efb98327b51d', 'request_id': 'req-971ae521-5afb-4b77-878b-78cbf44aee6e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.480571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cf7624c58b46f1b780efb98327b51d', 'request_id': 'req-971ae521-5afb-4b77-878b-78cbf44aee6e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.483927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:53.494558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] The token cache is being invalidate because project c6cf7624c58b46f1b780efb98327b51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:59:53.494949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.495675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.497725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1234/2437] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:59:53 2022] DELETE /identity/v3/projects/c6cf7624c58b46f1b780efb98327b51d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:53.501665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:53.514679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c289a-65f0-4efa-99a5-36c93e5ed038 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:53.565724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:53.614521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:53.615738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:53.615738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:53.616159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] PATH_INFO: `/v3/users/4542cecc6a0549b5a28ffed4cdeb37af` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:53.617923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4542cecc6a0549b5a28ffed4cdeb37af)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:53.621015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:53.900843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4542cecc6a0549b5a28ffed4cdeb37af'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.905684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4542cecc6a0549b5a28ffed4cdeb37af'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.929946 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4542cecc6a0549b5a28ffed4cdeb37af'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.933612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4542cecc6a0549b5a28ffed4cdeb37af'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:53.959128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4542cecc6a0549b5a28ffed4cdeb37af'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:54.037542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1204/2438] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:59:53 2022] DELETE /identity/v3/users/4542cecc6a0549b5a28ffed4cdeb37af => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:54.504133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:54.507693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:54.533691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae521-5afb-4b77-878b-78cbf44aee6e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:54.629760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:54.630478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:54.630811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:54.631141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] PATH_INFO: `/v3/users/2b2a09149561465799af85ae6bec7b12` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:54.632567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2a09149561465799af85ae6bec7b12)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:54.634634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:55.061281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:55.062604 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:55.071675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2a09149561465799af85ae6bec7b12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.072632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2a09149561465799af85ae6bec7b12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.081628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2a09149561465799af85ae6bec7b12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.092394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d57b90-65fd-4318-ba01-f5415e17b0e2 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:55.098235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2a09149561465799af85ae6bec7b12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.099146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-abfae495-0fc9-489f-b78b-f2fba6367d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2a09149561465799af85ae6bec7b12'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.100702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:55.101490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:55.101834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:55.102175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] PATH_INFO: `/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:55.114139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27abbdfc8be74c4e9c7f5731cb8a5e26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:55.121086 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:55.636430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1235/2439] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 10:59:54 2022] DELETE /identity/v3/users/2b2a09149561465799af85ae6bec7b12 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:55.658270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27abbdfc8be74c4e9c7f5731cb8a5e26', 'request_id': 'req-95ee9d59-340b-4ee0-8afe-b61e76153de5'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:55.664770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27abbdfc8be74c4e9c7f5731cb8a5e26', 'request_id': 'req-95ee9d59-340b-4ee0-8afe-b61e76153de5'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.207037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27abbdfc8be74c4e9c7f5731cb8a5e26', 'request_id': 'req-95ee9d59-340b-4ee0-8afe-b61e76153de5'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.218775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] The token cache is being invalidate because project 27abbdfc8be74c4e9c7f5731cb8a5e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:59:56.219066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.219689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.222064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1205/2440] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:59:55 2022] DELETE /identity/v3/projects/27abbdfc8be74c4e9c7f5731cb8a5e26 => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:56.227494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b14b7-46e4-4926-aa68-0528406f3d26 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.227785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b14b7-46e4-4926-aa68-0528406f3d26 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.228059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b14b7-46e4-4926-aa68-0528406f3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.247768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-860b14b7-46e4-4926-aa68-0528406f3d26 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:56.249033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-860b14b7-46e4-4926-aa68-0528406f3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.260697 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.262150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.318352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:56.337044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1236/2441] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:56.343960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9d59-340b-4ee0-8afe-b61e76153de5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.344929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.346950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.346950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.352953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.354045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.354045 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.354531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] PATH_INFO: `/v3/projects/4f1d9aefea6542a7b524f367a4cc9d84` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.355769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1d9aefea6542a7b524f367a4cc9d84)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.357789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.370045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:56.371290 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.382182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1237/2442] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:56.386831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.398123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27595aef-e76d-417e-a622-d5f093906a7b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.403319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.403938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.404240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.404489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.405222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:59:56.405577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.407191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.410936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:56.421052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1238/2443] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:59:56.425219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.435304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74f68-067e-423e-ac6a-a3d1a8770626 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.441471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.441908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.448892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.448892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.448892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.448892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.494991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1d9aefea6542a7b524f367a4cc9d84', 'request_id': 'req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.505084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1d9aefea6542a7b524f367a4cc9d84', 'request_id': 'req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.562158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1239/2444] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:56.570880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.584683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1d9aefea6542a7b524f367a4cc9d84', 'request_id': 'req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.601328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] The token cache is being invalidate because project 4f1d9aefea6542a7b524f367a4cc9d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:59:56.601631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.602327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8dd4c1f3-6dfe-4215-b27b-ad77f95891fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:59:56.604156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1206/2445] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 10:59:56 2022] DELETE /identity/v3/projects/4f1d9aefea6542a7b524f367a4cc9d84 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:56.608799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e09cc-fa3f-40a8-ad73-47ae048fd69c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.609164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e09cc-fa3f-40a8-ad73-47ae048fd69c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.609532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e09cc-fa3f-40a8-ad73-47ae048fd69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.645006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-cd5e09cc-fa3f-40a8-ad73-47ae048fd69c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:56.646318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cd5e09cc-fa3f-40a8-ad73-47ae048fd69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.668387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b05e-f497-4a5c-976a-739dee87c6b8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.676388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.677053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.677478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.677758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.678406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.680470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.728636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1207/2446] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:56.737499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.737867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.738152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.767486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:56.769030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.782408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1208/2447] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:56.785301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.788686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1240/2448] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:59:56.793685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.795820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c32402-e0c1-421c-81a7-187b558ac32d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.796044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:56.807095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.808948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.809230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.809504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.810171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:59:56.811139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.813450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.815286 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c34de-d5b5-46f2-b983-08e06cd0def6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.821910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.823330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.823795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.826877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.826877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.830925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.837017 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1209/2449] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 10:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:59:56.837766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.850071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbdf01-afdb-4519-a788-2d2ac1575619 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.855222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.855846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1241/2450] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:59:56.855966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.856130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.856379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.857480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.859163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.860162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.875466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb6b2-19c9-48b6-972a-58a3c50bf620 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.881472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.882308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.882583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.882884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.883557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.885208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:56.901236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1242/2451] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:56.905518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:56.916028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc761-af8d-4b03-aec6-4296424c7569 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:56.922088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:56.936718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:56.936718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:56.936718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] PATH_INFO: `/v3/projects/90efcc320aec475c864ac055e6ffb856/users/bc590fb82fd3450e960c0f3f662ca2d0/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:56.940572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90efcc320aec475c864ac055e6ffb856, user_id=bc590fb82fd3450e960c0f3f662ca2d0, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:56.943295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4ecaa-6e47-4059-8183-9a74236fbeb2 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.008925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1210/2452] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:56 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:57.009783 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.030431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1243/2453] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:56 2022] PUT /identity/v3/projects/90efcc320aec475c864ac055e6ffb856/users/bc590fb82fd3450e960c0f3f662ca2d0/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:59:57.045052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.046764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.046764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.093320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] MFA Rules not processed for user `bc590fb82fd3450e960c0f3f662ca2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:57.095307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:57.097775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:57.135118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2af62-6d60-467b-be39-79036861d5de admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.210045 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1244/2454] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:59:57.215181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.228081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:57.276551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.283685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.283685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.283685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.283685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.283685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.336731 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da15e4-25b1-4dc8-9ac1-5def68e131b3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.342382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.343074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.343424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.343784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.344527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.347305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.376352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1211/2455] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:57 2022] POST /identity/v3/users => generated 286 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:57.381836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.392711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd361db-aee2-4a17-9c80-1ec644593b1c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.398032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.398640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.398919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.399186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.399827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.401606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.417110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1212/2456] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:57.418054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.429881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a71fe-b05a-4a11-8a1d-eacb577ebda3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.435284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.435889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.436222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.436489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.437620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.445116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.453684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1245/2457] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 10:59:57 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:57.455047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.459447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1213/2458] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:59:57.460324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.477103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a002eb-d4fc-4e5c-a71c-7b507f817f88 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.552189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57b88c-4899-4356-b967-69767cf0fbd6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.565309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.566385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.566825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.567466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.569322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.569880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.570279 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.570386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] PATH_INFO: `/v3/projects/d305869b257b4e2e83a6d45207d20cb9/users/a822b44675bc4865adc50ae6ecc3da54/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.570667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.573221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.589872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d305869b257b4e2e83a6d45207d20cb9, user_id=a822b44675bc4865adc50ae6ecc3da54, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.592520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829a6e8-4400-4806-96d5-bab619cad3be admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.670443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1246/2459] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 10:59:57 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:59:57.671574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.682995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd5fc-2ed5-49b7-a90b-9dfe5166888c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.687986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.688639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.688921 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.689221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.689859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.691472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.705609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1247/2460] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:59:57.711400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.720228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1214/2461] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:57 2022] PUT /identity/v3/projects/d305869b257b4e2e83a6d45207d20cb9/users/a822b44675bc4865adc50ae6ecc3da54/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:57.725974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.726284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.726565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.727200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb7094-24ae-4a14-9ced-0552c2221ff6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.749219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:57.750451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:57.776064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:57.818121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.819043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.819472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.819979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] PATH_INFO: `/v3/projects/91377b11d43b422ab3092a3a252271c0/users/3dcda8bd104944899f11e14a5c500dd2/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.836355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1215/2462] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:57.839632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91377b11d43b422ab3092a3a252271c0, user_id=3dcda8bd104944899f11e14a5c500dd2, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.842544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.849384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:57.853505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:57.855040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:57.932215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ae0df-8391-4831-88f9-9e998b30d66e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:57.936737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:57.937339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:57.937614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:57.937924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:57.953862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:57.955530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:57.972084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1216/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:59:57.988664 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1248/2464] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:57 2022] PUT /identity/v3/projects/91377b11d43b422ab3092a3a252271c0/users/3dcda8bd104944899f11e14a5c500dd2/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:57.990479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:58.004814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43020-5bb0-49d3-ad16-35eb2d3849e6 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:58.074241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:58.074862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:58.075352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:58.075722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:58.076166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:58.077995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1f35c-cf76-4a37-ba8d-3d2359c8232a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:58.092711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1217/2465] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 10:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:59:58.093886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:58.110505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628765-8813-4058-be8f-4780934ee10c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:58.121018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:58.122006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:58.122720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:58.123630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] PATH_INFO: `/v3/projects/91377b11d43b422ab3092a3a252271c0/users/3dcda8bd104944899f11e14a5c500dd2/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:58.126358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91377b11d43b422ab3092a3a252271c0, user_id=3dcda8bd104944899f11e14a5c500dd2, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:58.130803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:58.161350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1249/2466] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 10:59:58 2022] PUT /identity/v3/projects/91377b11d43b422ab3092a3a252271c0/users/3dcda8bd104944899f11e14a5c500dd2/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:59:58.162235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:58.162524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:58.162796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:58.199386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] MFA Rules not processed for user `3dcda8bd104944899f11e14a5c500dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:59:58.201175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:58.270546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:59:58.297629 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1218/2467] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 10:59:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:59:58.312546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:59:58.314795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:59:58.419087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc7eda-65a4-4f1c-aa45-53ac7fb7c66f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:59:58.424475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:59:58.425456 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:59:58.425940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:59:58.426604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:59:58.445136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:59:58.447352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206ffa0-dc3c-4279-9acc-836430efe1cc service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:59:58.479376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1250/2468] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 10:59:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:00.004184 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:00.085251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0ed6-0f35-4865-b804-7604594b1856 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:00.090873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:00.091759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:00.092211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:00.092647 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] PATH_INFO: `/v3/users/bc590fb82fd3450e960c0f3f662ca2d0` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:00.094146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc590fb82fd3450e960c0f3f662ca2d0)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:00.096701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:00.352935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc590fb82fd3450e960c0f3f662ca2d0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:00.353973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc590fb82fd3450e960c0f3f662ca2d0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:00.363282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc590fb82fd3450e960c0f3f662ca2d0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:00.364390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc590fb82fd3450e960c0f3f662ca2d0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:00.397931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc590fb82fd3450e960c0f3f662ca2d0'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:00.549952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1219/2469] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:00 2022] DELETE /identity/v3/users/bc590fb82fd3450e960c0f3f662ca2d0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:00.554779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:00.555253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:00.555445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:00.575639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:00.576924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:00.639151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1251/2470] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:00.650248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:00.651741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:00.728083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40602a-723f-41ac-b59a-2189fff15dbd admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:00.747129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:00.747862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:00.748217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:00.748649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:00.771468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:00.777436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:00.790498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1220/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:01.508213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:01.509769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:01.523705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d9ec1-7bb9-4802-8a48-8869d4b5ed8f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:01.529094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:01.529862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:01.530211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:01.530795 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] PATH_INFO: `/v3/projects/90efcc320aec475c864ac055e6ffb856` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:01.532077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=90efcc320aec475c864ac055e6ffb856)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:01.542751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:01.718566 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90efcc320aec475c864ac055e6ffb856', 'request_id': 'req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:01.730781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90efcc320aec475c864ac055e6ffb856', 'request_id': 'req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:01.852249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90efcc320aec475c864ac055e6ffb856', 'request_id': 'req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:01.879090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] The token cache is being invalidate because project 90efcc320aec475c864ac055e6ffb856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:01.880571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:01.881289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:01.883576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1252/2472] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:01 2022] DELETE /identity/v3/projects/90efcc320aec475c864ac055e6ffb856 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:01.887996 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:01.900098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33cd84-28fc-4ef4-9872-de2171871878 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:01.912318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:01.998226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:01.998739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:01.999185 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:01.999465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] PATH_INFO: `/v3/users/3dcda8bd104944899f11e14a5c500dd2` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:02.000747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcda8bd104944899f11e14a5c500dd2)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:02.004399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:02.247638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcda8bd104944899f11e14a5c500dd2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:02.248963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcda8bd104944899f11e14a5c500dd2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:02.257356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcda8bd104944899f11e14a5c500dd2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:02.257954 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcda8bd104944899f11e14a5c500dd2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:02.294411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-36ae8313-3f3b-4437-bf0d-ab86ddbbb598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcda8bd104944899f11e14a5c500dd2'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:02.377810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1221/2473] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:01 2022] DELETE /identity/v3/users/3dcda8bd104944899f11e14a5c500dd2 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:03.268734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:03.270244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:03.284407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2b67c-98d4-4af1-a1bf-c4ebabd814ad admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:03.291203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:03.384710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:03.385712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:03.386186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:03.386822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] PATH_INFO: `/v3/projects/91377b11d43b422ab3092a3a252271c0` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:03.388444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91377b11d43b422ab3092a3a252271c0)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:03.390972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:03.520472 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91377b11d43b422ab3092a3a252271c0', 'request_id': 'req-74dfb9ed-36d9-4937-84b1-771893c386c5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:03.526482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91377b11d43b422ab3092a3a252271c0', 'request_id': 'req-74dfb9ed-36d9-4937-84b1-771893c386c5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:03.669368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91377b11d43b422ab3092a3a252271c0', 'request_id': 'req-74dfb9ed-36d9-4937-84b1-771893c386c5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:03.686536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] The token cache is being invalidate because project 91377b11d43b422ab3092a3a252271c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:03.695126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:03.695126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-74dfb9ed-36d9-4937-84b1-771893c386c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:03.695126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1253/2474] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:03 2022] DELETE /identity/v3/projects/91377b11d43b422ab3092a3a252271c0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:03.697409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:03.698222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:03.698646 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:03.735528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:03.735528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:03.828972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1222/2475] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:03.833297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:03.833819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:03.834245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:03.856964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:03.858504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:03.868759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1254/2476] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:03.873099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:03.885036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223389-348f-4b29-8538-3c2bfb9d4413 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:03.891323 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:03.892010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:03.892880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:03.893402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:03.894080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:00:03.894417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:03.896197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:03.919930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1223/2477] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:00:03.921638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:03.933660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1f7a9-bf84-4b43-90a9-bf0b260544f3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:03.939550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:03.940321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:03.940711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:03.941217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:03.941891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:03.943884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.065854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1255/2478] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:03 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:04.070417 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:04.084912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cad2b-6264-4828-bbcb-e534497882e9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:04.106370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:04.175932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:04.177716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.178098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.178547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.179206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:04.181212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.291022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1224/2479] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:04 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:04.291925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:04.323360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2106-3830-45b1-94ce-ce80cdfca61b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:04.325723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:04.327067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.327555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.328001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.328850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:04.330461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.350727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:04.364252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1256/2480] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:04.371776 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7950f-0dec-4cc4-a917-1d9acb92ed66 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:04.382751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:04.383674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.384120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.384544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.385440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:04.387238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a228f96-b5b0-4704-b602-f4a1c29aea51 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.404874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1225/2481] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:04.407324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:04.427465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c0a5b-d3cc-451b-8b55-0d8031a81234 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:04.432541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:04.433367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.433701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.437015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] PATH_INFO: `/v3/projects/6b8414f7818b44aaa47fb219b919b48f/users/68c0a4fcda144af3ad213cc48b57df78/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.451669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8414f7818b44aaa47fb219b919b48f, user_id=68c0a4fcda144af3ad213cc48b57df78, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:04.457121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.564338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1257/2482] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:04 2022] PUT /identity/v3/projects/6b8414f7818b44aaa47fb219b919b48f/users/68c0a4fcda144af3ad213cc48b57df78/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:04.576513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98c6a-062e-402d-b8a3-d21970faf6d8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.576823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98c6a-062e-402d-b8a3-d21970faf6d8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.577104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98c6a-062e-402d-b8a3-d21970faf6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.640503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b2a98c6a-062e-402d-b8a3-d21970faf6d8 None None] MFA Rules not processed for user `68c0a4fcda144af3ad213cc48b57df78`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:04.642764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b2a98c6a-062e-402d-b8a3-d21970faf6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:04.756127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1226/2483] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:04.760413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:04.814013 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:04.852872 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e61419-2f33-4546-bede-e2cd2ba21e46 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:04.860017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:04.861923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.861923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.861923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:04.862645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:04.864784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:04.962005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:04.962005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:04.962214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.008501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] MFA Rules not processed for user `a822b44675bc4865adc50ae6ecc3da54`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:05.009905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:05.055441 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1258/2484] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:04 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:05.059575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.080948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1227/2485] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:05.090448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.092744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:05.114447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd877-84a4-420a-b1b1-a4e0130058c4 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.131475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232553-6780-49d1-8c6e-732f143fdcd9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.136404 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.137042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.137438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.137882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.138531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.140533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.156215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:05.179475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.180089 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.180365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.180705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.181320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.183216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.291131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1228/2486] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:05 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:05.294953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1259/2487] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:05 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:05.295659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.296797 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.307713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739334-a0ef-4a95-9c89-b5cda8e905e5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.366020 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.366476 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45af6-689c-4c5d-bc3d-65bade56b757 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.366642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.366923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.367195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.367841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.369488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.371265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.371871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.372149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.372420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.373139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.375079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.379674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1260/2488] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:05.383983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.394608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1a5c-a57c-4dc6-b464-c9b5cf2c6773 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.399471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.400122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.400402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.400714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] PATH_INFO: `/v3/projects/663614af2e4e407bb2afa4c77c6645e2/users/204abf0502b34875b8eea6fb488e2392/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.416453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663614af2e4e407bb2afa4c77c6645e2, user_id=204abf0502b34875b8eea6fb488e2392, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.419151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.521236 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1229/2489] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:05 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:05.522229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.530875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1261/2490] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:05 2022] PUT /identity/v3/projects/663614af2e4e407bb2afa4c77c6645e2/users/204abf0502b34875b8eea6fb488e2392/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:05.534671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.536091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1224e-45a5-4cde-bb3d-28fba91e57f8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.595964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041062-1493-4826-8495-4251ef593cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.596581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041062-1493-4826-8495-4251ef593cab admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.596912 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041062-1493-4826-8495-4251ef593cab admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.597160 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041062-1493-4826-8495-4251ef593cab admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.597819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87041062-1493-4826-8495-4251ef593cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.599447 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87041062-1493-4826-8495-4251ef593cab admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.601001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d48e-d429-433e-974f-d39f77cff211 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.605778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.606381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.606660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.606929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.607562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.609204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.609725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1230/2491] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:05.614651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041062-1493-4826-8495-4251ef593cab admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.624624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1262/2492] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:05.627445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.629130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041062-1493-4826-8495-4251ef593cab admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.641684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.641684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.641684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.641684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] PATH_INFO: `/v3/projects/83aac642e1824f27bc68a330198854b2/users/2072da8773504f7e88aeffb109906298/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.642799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6ae17-8636-4d7f-ba5d-d3cb170f67b5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.644637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.645374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.645713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.646066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] PATH_INFO: `/v3/projects/663614af2e4e407bb2afa4c77c6645e2/users/204abf0502b34875b8eea6fb488e2392/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.648118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663614af2e4e407bb2afa4c77c6645e2, user_id=204abf0502b34875b8eea6fb488e2392, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.650865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68900e6-b332-4ea7-98e3-3526ef576d67 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.654339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aac642e1824f27bc68a330198854b2, user_id=2072da8773504f7e88aeffb109906298, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.657039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.662241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1263/2493] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:05 2022] PUT /identity/v3/projects/663614af2e4e407bb2afa4c77c6645e2/users/204abf0502b34875b8eea6fb488e2392/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:05.672422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.672904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.673394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.709197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] MFA Rules not processed for user `204abf0502b34875b8eea6fb488e2392`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:05.710650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:05.781434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1264/2494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:05.793176 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.794621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:05.814098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1231/2495] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:05 2022] PUT /identity/v3/projects/83aac642e1824f27bc68a330198854b2/users/2072da8773504f7e88aeffb109906298/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:05.819321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.878787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda7a6a-a0a6-42ee-8cc7-68a2012e50f6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.888296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba7d9-bba8-4543-961c-6587cec8df80 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.896726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.896726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.896726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.896726 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.897187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.898434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.910437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1232/2496] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:05.914480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:05.926733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e98f0-34ed-4eb9-85c4-1902a25de159 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:05.932854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.937087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.937087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.937087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.937818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:05.937818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:05.938100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:05.938191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] PATH_INFO: `/v3/projects/83aac642e1824f27bc68a330198854b2/users/2072da8773504f7e88aeffb109906298/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:05.941064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aac642e1824f27bc68a330198854b2, user_id=2072da8773504f7e88aeffb109906298, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:05.944018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:05.958692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1233/2497] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:05 2022] PUT /identity/v3/projects/83aac642e1824f27bc68a330198854b2/users/2072da8773504f7e88aeffb109906298/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:06.018230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:06.019898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265ee7-a6f7-4d2f-a002-dc007d7a7d00 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:06.034059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1265/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:00:06.052216 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:06.139272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:06.629639 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:07.539938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:07.617655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01feba-ff02-4d21-b0f5-10ef6e2ea1a7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:07.622762 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:07.623704 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:07.623998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:07.624269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] PATH_INFO: `/v3/users/68c0a4fcda144af3ad213cc48b57df78` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:07.625701 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c0a4fcda144af3ad213cc48b57df78)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:07.627823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:07.998195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c0a4fcda144af3ad213cc48b57df78'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:07.999008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c0a4fcda144af3ad213cc48b57df78'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:08.007331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c0a4fcda144af3ad213cc48b57df78'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:08.008195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c0a4fcda144af3ad213cc48b57df78'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:08.023036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c0a4fcda144af3ad213cc48b57df78'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:08.168508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1234/2499] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:07 2022] DELETE /identity/v3/users/68c0a4fcda144af3ad213cc48b57df78 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:08.177434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:08.177434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:08.177434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:08.216190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:08.217974 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:08.319107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1266/2500] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:08.329317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:08.331334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:08.338847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:08.397036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3890-f1a9-49c7-ae5d-4519656fa361 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:08.400843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:08.401471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:08.401747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:08.402040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:08.411941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:08.413404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:08.424570 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1235/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:09.059255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:09.059255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:09.071456 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571866b-9a56-4ea6-834d-98d0c3415619 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:09.081573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:09.082569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:09.082861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:09.083116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] PATH_INFO: `/v3/projects/6b8414f7818b44aaa47fb219b919b48f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:09.084513 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8414f7818b44aaa47fb219b919b48f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:09.090007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:09.243140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8414f7818b44aaa47fb219b919b48f', 'request_id': 'req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.252854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8414f7818b44aaa47fb219b919b48f', 'request_id': 'req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.372365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8414f7818b44aaa47fb219b919b48f', 'request_id': 'req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.385720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] The token cache is being invalidate because project 6b8414f7818b44aaa47fb219b919b48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:09.386015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.386689 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.388267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1267/2502] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:09 2022] DELETE /identity/v3/projects/6b8414f7818b44aaa47fb219b919b48f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:09.393677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:09.403466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73094647-5cfe-4250-b872-65f68d71b12b service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:09.466034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:09.466662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:09.466939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:09.467206 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] PATH_INFO: `/v3/users/204abf0502b34875b8eea6fb488e2392` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:09.468334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=204abf0502b34875b8eea6fb488e2392)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:09.470817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:09.760474 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204abf0502b34875b8eea6fb488e2392'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.761595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204abf0502b34875b8eea6fb488e2392'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.771462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204abf0502b34875b8eea6fb488e2392'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.772190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204abf0502b34875b8eea6fb488e2392'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.786472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-deb4d143-7d1f-41a2-8f2c-a063bf3cbcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204abf0502b34875b8eea6fb488e2392'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:09.894231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1236/2503] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:09 2022] DELETE /identity/v3/users/204abf0502b34875b8eea6fb488e2392 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:10.605982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:10.607300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:10.630252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6bbf-5dea-4acc-be3e-c8480703bcc7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:10.649444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:10.734067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:10.735046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:10.735508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:10.736211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] PATH_INFO: `/v3/projects/663614af2e4e407bb2afa4c77c6645e2` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:10.737355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663614af2e4e407bb2afa4c77c6645e2)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:10.739444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:10.931077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663614af2e4e407bb2afa4c77c6645e2', 'request_id': 'req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:10.941303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663614af2e4e407bb2afa4c77c6645e2', 'request_id': 'req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:11.081751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663614af2e4e407bb2afa4c77c6645e2', 'request_id': 'req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:11.100929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] The token cache is being invalidate because project 663614af2e4e407bb2afa4c77c6645e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:11.101886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:11.108445 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3f31d62d-fe39-42db-bc3c-1fe73d414eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:11.109743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1268/2504] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:10 2022] DELETE /identity/v3/projects/663614af2e4e407bb2afa4c77c6645e2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:11.111965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.112371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.112515 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.145781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:11.148728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:11.178874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:11.253533 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.253801 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.254076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.260737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1237/2505] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:11.281444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:11.284082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:11.296029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1269/2506] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:11.300695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.317036 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5063964-b091-4c51-957f-62c03c2b0556 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.323096 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.323934 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.324215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.327007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.327007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:00:11.327007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.327593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.342797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1238/2507] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 11:00:11.347006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.356608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aa213-1175-4253-994f-a7b2a9a50743 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.363049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.363809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.364090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.364366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.365052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.366983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.492244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1270/2508] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:11.493430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.503781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b81b-8886-4243-8ba4-64f47d7a2a3f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.574342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.575328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.575328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.575754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.576617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.578602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51239e-2e68-4241-915f-1b5d5dc01982 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.684060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1239/2509] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:11.687728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.702575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688cb1f-e2a1-480f-849f-dadab9024cd6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.711178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.712204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.714789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.714789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.714789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.716575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.717819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.718105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.718380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.729135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1271/2510] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:11.733486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.748065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:11.749342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:11.750219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c6ff5-afeb-4016-a089-232db231201f admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.758041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.758683 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.758965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.759238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.759883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.761543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.772890 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1272/2511] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:11.777024 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.788454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f7dc-aa8e-444b-91fb-b6c45bac9461 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.793184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.793893 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.794190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.794442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] PATH_INFO: `/v3/projects/689559d0121d433db9194d5caba7f60e/users/a9778af4fd104bf983e15300e91c02f6/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.813480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689559d0121d433db9194d5caba7f60e, user_id=a9778af4fd104bf983e15300e91c02f6, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.816693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe2d5e-1246-4834-adcf-46a8af8fbc00 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.824639 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1240/2512] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:11.838786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:11.840340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:11.918179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929be353-162e-42c9-8ceb-10b28b0bc699 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:11.925281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:11.925844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.926131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.926405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.935969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:11.937859 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:11.950235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1273/2513] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:11 2022] PUT /identity/v3/projects/689559d0121d433db9194d5caba7f60e/users/a9778af4fd104bf983e15300e91c02f6/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:11.966576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:11.966865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:11.967140 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:11.972207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1241/2514] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 11:00:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 11:00:12.035763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] MFA Rules not processed for user `a9778af4fd104bf983e15300e91c02f6`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:12.038525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:12.471669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1274/2515] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:12.473732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:12.491967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50218b83-292e-44cf-8401-a65e42347417 service swift] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:12.593984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:12.595317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:12.595935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:12.596401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:12.597301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:12.599586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:12.722677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:12.723320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1242/2516] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:12 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:12.743338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd359d-6694-450d-92f9-260d0231b851 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:12.779607 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:12.830852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:12.867056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:12.867743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:12.868026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:12.868297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:12.869487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:12.871634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:13.031112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1275/2517] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:12 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:13.035756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:13.057457 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352eb2b-7a5d-4703-8e63-f0a40dd651ae admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:13.081334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:13.081998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.082314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.082598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.083269 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:13.085180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:13.118643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1243/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:13.122485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:13.150515 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585a1-0aa7-4919-bc59-4088de211593 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:13.162763 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:13.163887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.164423 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.166691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] PATH_INFO: `/v3/projects/66c849bcde8745449ceea7885b2e2e36/users/165d4b9d6e7541d5a4e9ef542d530f4e/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.204364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c849bcde8745449ceea7885b2e2e36, user_id=165d4b9d6e7541d5a4e9ef542d530f4e, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:13.208012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:13.333397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1276/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:13 2022] PUT /identity/v3/projects/66c849bcde8745449ceea7885b2e2e36/users/165d4b9d6e7541d5a4e9ef542d530f4e/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:13.337622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:13.357374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ddd73-1e42-463b-b3a2-bfb15dcc0f31 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:13.558062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:13.562532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.562532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.562532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.562532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:13.562532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c6b5-4b4e-4e79-92dc-dbc0cafc57dc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:13.587792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1244/2520] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:13.589661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:13.607232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec8de-1dea-46f4-a83d-ea40fb6a2da5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:13.627084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:13.628142 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.628621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.629104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] PATH_INFO: `/v3/projects/66c849bcde8745449ceea7885b2e2e36/users/165d4b9d6e7541d5a4e9ef542d530f4e/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.632166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c849bcde8745449ceea7885b2e2e36, user_id=165d4b9d6e7541d5a4e9ef542d530f4e, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:13.635739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655b52-a40a-4699-9d91-de35b1d0f3a5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:13.670771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1277/2521] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:13 2022] PUT /identity/v3/projects/66c849bcde8745449ceea7885b2e2e36/users/165d4b9d6e7541d5a4e9ef542d530f4e/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:13.673723 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.674268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.674834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.752397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] MFA Rules not processed for user `165d4b9d6e7541d5a4e9ef542d530f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:13.758390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:13.823804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:13.888284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:13.889601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:13.890094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:13.912388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1245/2522] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:13.936971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:13.939370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:14.001984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] MFA Rules not processed for user `2072da8773504f7e88aeffb109906298`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:14.003589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:14.102552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304f4bf-e3b6-4bc1-ade3-07ab88ee1f39 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:14.126186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:14.128202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:14.128714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:14.129005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:14.147005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:14.150049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:14.168173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:14.170943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1246/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:00:14.183048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1278/2524] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:14.195978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:14.197883 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:14.390277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7142ec-9ced-48ae-95ff-4b93c73aac91 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:14.398963 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:14.400797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:14.401170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:14.401707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:14.405631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:14.613973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:14.615670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7872-f3b3-45f7-8a64-caa75fef2597 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:14.639755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1247/2525] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:14.989100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:15.085900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d02a40-5872-44ff-a33d-79fe3f6a9b7f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:15.098941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:15.099737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:15.100122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:15.100501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] PATH_INFO: `/v3/users/a9778af4fd104bf983e15300e91c02f6` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:15.101898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9778af4fd104bf983e15300e91c02f6)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:15.103978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:15.507523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9778af4fd104bf983e15300e91c02f6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:15.508211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9778af4fd104bf983e15300e91c02f6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:15.515930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9778af4fd104bf983e15300e91c02f6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:15.534181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9778af4fd104bf983e15300e91c02f6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:15.541466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9778af4fd104bf983e15300e91c02f6'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:15.670066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1279/2526] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:14 2022] DELETE /identity/v3/users/a9778af4fd104bf983e15300e91c02f6 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:15.675835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:15.675835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:15.675835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:15.699068 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:15.700573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:15.712899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:15.775856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1248/2527] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:15.793444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:15.796951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:15.957307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5310d-7ab4-40e1-8c2d-d43837de1f0d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:15.970570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:15.973395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:15.974321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:15.975158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:15.997873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:15.999543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:16.041324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1280/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:16.866324 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:16.867989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:16.891234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c350-73ed-46e8-bd71-37f75d2dfe79 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:16.897685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:16.898419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:16.898605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:16.899329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] PATH_INFO: `/v3/projects/689559d0121d433db9194d5caba7f60e` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:16.900777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689559d0121d433db9194d5caba7f60e)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:16.902827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:17.135632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689559d0121d433db9194d5caba7f60e', 'request_id': 'req-6d7d79ea-f73e-462f-b084-77a3efe40cd7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.148270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689559d0121d433db9194d5caba7f60e', 'request_id': 'req-6d7d79ea-f73e-462f-b084-77a3efe40cd7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.239901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689559d0121d433db9194d5caba7f60e', 'request_id': 'req-6d7d79ea-f73e-462f-b084-77a3efe40cd7'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.275584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] The token cache is being invalidate because project 689559d0121d433db9194d5caba7f60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:17.275584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.275584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.275584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1249/2529] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:16 2022] DELETE /identity/v3/projects/689559d0121d433db9194d5caba7f60e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:17.286502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:17.296737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f6b9-b38c-4fcd-9592-35bcb0bdbbee service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:17.317199 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:17.384648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:17.385522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:17.386172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:17.386631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] PATH_INFO: `/v3/users/165d4b9d6e7541d5a4e9ef542d530f4e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:17.388016 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] RBAC: Authorizing `identity:delete_user(user_id=165d4b9d6e7541d5a4e9ef542d530f4e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:17.390390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:17.677459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165d4b9d6e7541d5a4e9ef542d530f4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.678192 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165d4b9d6e7541d5a4e9ef542d530f4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.692531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165d4b9d6e7541d5a4e9ef542d530f4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.711773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165d4b9d6e7541d5a4e9ef542d530f4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.713000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f3a582-ffa0-42e3-8225-ecc73500156d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165d4b9d6e7541d5a4e9ef542d530f4e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:17.826785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1281/2530] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:17 2022] DELETE /identity/v3/users/165d4b9d6e7541d5a4e9ef542d530f4e => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:18.558221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:18.558221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:18.590600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d79ea-f73e-462f-b084-77a3efe40cd7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:18.680665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:18.681686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:18.682085 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:18.682388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] PATH_INFO: `/v3/projects/66c849bcde8745449ceea7885b2e2e36` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:18.684031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c849bcde8745449ceea7885b2e2e36)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:18.686537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:18.892747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:18.913636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c849bcde8745449ceea7885b2e2e36', 'request_id': 'req-56bef055-36e6-4af0-a871-8b8aaa4c647c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:18.931101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c849bcde8745449ceea7885b2e2e36', 'request_id': 'req-56bef055-36e6-4af0-a871-8b8aaa4c647c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:19.104073 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c849bcde8745449ceea7885b2e2e36', 'request_id': 'req-56bef055-36e6-4af0-a871-8b8aaa4c647c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:19.120062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] The token cache is being invalidate because project 66c849bcde8745449ceea7885b2e2e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:19.120800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:19.122048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-56bef055-36e6-4af0-a871-8b8aaa4c647c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:19.124042 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1250/2531] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:18 2022] DELETE /identity/v3/projects/66c849bcde8745449ceea7885b2e2e36 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:19.130896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3e68-31e1-48d5-8842-91aabfe66e78 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.131401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3e68-31e1-48d5-8842-91aabfe66e78 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.131860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3e68-31e1-48d5-8842-91aabfe66e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.175237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ed7b3e68-31e1-48d5-8842-91aabfe66e78 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:19.176562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ed7b3e68-31e1-48d5-8842-91aabfe66e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:19.279407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1282/2532] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:19.304770 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.305063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.307271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.364695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.365406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.365819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.376995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] MFA Rules not processed for user `a822b44675bc4865adc50ae6ecc3da54`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:19.378593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:19.394736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:19.396840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:19.432321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1283/2533] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:19.434675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:19.456182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7242-9d67-456b-9a3d-8dc1722d07bb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:19.462405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:19.463792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.464473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.464615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.465904 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:00:19.466403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:19.468768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:19.490686 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1284/2534] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:00:19.495212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:19.514693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616b31a-7463-4c50-ab8e-c2a8b237d144 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:19.521156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1251/2535] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:19.539460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:19.540234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.540673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.540950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.544528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:19.547106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:19.683054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:19.702740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:19.703401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1285/2536] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:19 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:19.717738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6c681-2fc2-4187-b752-5c57146c4fdd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:19.868249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:19.870281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:19.870789 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:19.872301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:19.873874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:19.875872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:20.081950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1252/2537] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:19 2022] POST /identity/v3/users => generated 287 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:20.083659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:20.096330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055c07-6815-4486-ab99-197aeab50f93 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:20.114365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:20.114365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:20.114365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:20.114365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:20.115202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:20.115202 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:20.119269 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1286/2538] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:20.123460 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:20.134951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006305c9-cf52-46f9-bd43-ee04bf9ae390 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:20.149331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:20.149968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:20.150289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:20.150602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:20.151872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:20.152836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f43119-119f-46f9-b3f0-89da151fbfbe admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:20.165389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1253/2539] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:20.180451 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:20.196339 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ba27b-0e17-4779-b9fa-3972d48ebb9e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:20.203108 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:20.203957 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:20.204905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:20.205173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] PATH_INFO: `/v3/projects/864bdc0c2a9a4dc0a2d7b72af78832a4/users/719361e3e1934f40a2a9ecc72b80b4e7/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:20.223295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=864bdc0c2a9a4dc0a2d7b72af78832a4, user_id=719361e3e1934f40a2a9ecc72b80b4e7, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:20.225998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:20.532432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1287/2540] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:20 2022] PUT /identity/v3/projects/864bdc0c2a9a4dc0a2d7b72af78832a4/users/719361e3e1934f40a2a9ecc72b80b4e7/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:20.539008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b3e3-e701-42e0-be10-2429aa146aa8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:20.539296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b3e3-e701-42e0-be10-2429aa146aa8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:20.539584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b3e3-e701-42e0-be10-2429aa146aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:20.597721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-7194b3e3-e701-42e0-be10-2429aa146aa8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:20.599116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-7194b3e3-e701-42e0-be10-2429aa146aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:20.662545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:20.687530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1254/2541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:20.698107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:20.700512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:20.846847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b53995-22e0-4315-9962-31efc5352cad admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:20.855936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:20.857003 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:20.857325 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:20.857551 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:20.868519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:20.870092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:20.891317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1288/2542] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:22.601692 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:22.605509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:22.605509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:22.632169 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] MFA Rules not processed for user `719361e3e1934f40a2a9ecc72b80b4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:22.633525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:22.705788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1255/2543] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:22.710364 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:22.721594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c273420-6ace-4980-bfe8-bba9d0fa7b04 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:22.728869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:22.729484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:22.729764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:22.730049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:22.730737 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:22.732752 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:22.971813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1289/2544] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:22 2022] POST /identity/v3/projects => generated 371 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:22.979081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:22.987536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268c7f-bf78-4589-b4c6-1d74e8ec4f42 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:23.046988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:23.047607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:23.048537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:23.048957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:23.049610 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:23.051561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:23.166807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1256/2545] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:22 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:23.170959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:23.182264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad322b88-c25e-42f4-8090-b12ced608c35 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:23.188478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:23.188478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:23.188478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:23.188478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:23.189106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:23.190862 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:23.202236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1290/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:23.207230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:23.217761 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0231-0244-4ec7-8e59-b48bb9be911b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:23.223969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:23.224675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:23.224957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:23.225229 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] PATH_INFO: `/v3/projects/073b355043f34fadab52e33e4dd1b7a8/users/e7378b96b8994984a359ac62a9593f06/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:23.240433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=073b355043f34fadab52e33e4dd1b7a8, user_id=e7378b96b8994984a359ac62a9593f06, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:23.243187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:23.376002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1257/2547] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:23 2022] PUT /identity/v3/projects/073b355043f34fadab52e33e4dd1b7a8/users/e7378b96b8994984a359ac62a9593f06/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:23.380609 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:23.391153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaeea60-96eb-413a-9ce9-adebe6b8e141 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:23.447964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:23.448569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:23.448908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:23.449177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:23.449813 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:23.451593 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac94fc-da01-4e21-9854-4447090fdae1 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:23.461901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1291/2548] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:00:23.466255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:23.477423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6814-02f3-4815-9e54-f339f73fb27c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:23.482107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:23.482763 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:23.483041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:23.483311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] PATH_INFO: `/v3/projects/073b355043f34fadab52e33e4dd1b7a8/users/e7378b96b8994984a359ac62a9593f06/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:23.485852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073b355043f34fadab52e33e4dd1b7a8, user_id=e7378b96b8994984a359ac62a9593f06, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:23.488579 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:23.499909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1258/2549] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:23 2022] PUT /identity/v3/projects/073b355043f34fadab52e33e4dd1b7a8/users/e7378b96b8994984a359ac62a9593f06/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:25.111912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:25.112487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:25.112487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:25.146601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] MFA Rules not processed for user `e7378b96b8994984a359ac62a9593f06`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:25.147876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:25.174909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:25.233613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1292/2550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:25.246732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:25.248485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:25.288058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:25.311558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab0b5-2943-4d31-ae61-a24140b35354 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:25.318712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:25.318712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:25.318712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:25.318712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:25.382342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:25.383696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d65c6-8ed7-43fa-b813-28134010e0c5 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:25.393301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1259/2551] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:28.260730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:28.262179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:28.275025 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2264a8-5f0d-409e-bd2f-397116004ab4 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:28.278657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:28.279294 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:28.279564 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:28.279835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:28.289210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:28.297422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:28.301405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1293/2552] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:28.917746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:28.918251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:28.918251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:28.939004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:28.940458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:29.009541 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1260/2553] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 11:00:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:29.023740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:29.025273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:29.096959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a95-2102-4d07-bd29-7e84401bc97c service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:29.102165 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:29.102781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:29.103060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:29.103342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:29.111919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:29.113534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:29.121823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1294/2554] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 11:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 11:00:36.416018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:36.471292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e249a64-31ea-4928-bcb0-1c6549275b61 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:36.475000 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:36.475605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:36.475879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:36.476152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:36.477876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:36.488196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:36.489631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:36.497524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1261/2555] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:39.118330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=58 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:42.186562 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:42.196660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57d99-d02d-4701-8143-4242d84ba544 service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:42.200751 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:42.201591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:42.201937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:42.202303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:42.204818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:42.283711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:42.285196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:42.295336 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1295/2556] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:44.647980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:44.649573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:44.696843 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:44.730441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe888f-d22e-4266-9b16-2dcc82c0d9ab service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:44.733179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:44.733814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:44.734114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:44.734389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:44.736555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:44.748109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:44.749724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:44.760282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1262/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:45.707811 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:45.720892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7a57-1c0d-45cd-b30a-d3dc27ab7d53 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:45.736332 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:45.737295 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:45.737902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:45.738396 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] PATH_INFO: `/v3/users/719361e3e1934f40a2a9ecc72b80b4e7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:45.739765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] RBAC: Authorizing `identity:delete_user(user_id=719361e3e1934f40a2a9ecc72b80b4e7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:45.742006 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:46.026870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719361e3e1934f40a2a9ecc72b80b4e7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.027616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719361e3e1934f40a2a9ecc72b80b4e7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.041647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719361e3e1934f40a2a9ecc72b80b4e7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.051425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719361e3e1934f40a2a9ecc72b80b4e7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.052365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719361e3e1934f40a2a9ecc72b80b4e7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.187078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1296/2558] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:45 2022] DELETE /identity/v3/users/719361e3e1934f40a2a9ecc72b80b4e7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:46.506659 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:46.510933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:46.512818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:46.529706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a662c-5e0b-4467-b8fe-dcccb29b289b service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:46.590282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b2b1b-8d4a-42bd-a8d0-98968ad0454c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:46.590622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:46.591257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:46.591533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:46.591799 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] PATH_INFO: `/v3/projects/864bdc0c2a9a4dc0a2d7b72af78832a4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:46.593072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864bdc0c2a9a4dc0a2d7b72af78832a4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:46.595230 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:46.595401 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:46.595863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:46.596138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:46.596408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] PATH_INFO: `/v3/users/60c731fa91114cbebe4754e6e26ab756` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:46.597575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c731fa91114cbebe4754e6e26ab756)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:46.599549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:46.605155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:46.732951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864bdc0c2a9a4dc0a2d7b72af78832a4', 'request_id': 'req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.739300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864bdc0c2a9a4dc0a2d7b72af78832a4', 'request_id': 'req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.837434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864bdc0c2a9a4dc0a2d7b72af78832a4', 'request_id': 'req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.856757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] The token cache is being invalidate because project 864bdc0c2a9a4dc0a2d7b72af78832a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:46.856757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.856757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.856757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1263/2559] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:46 2022] DELETE /identity/v3/projects/864bdc0c2a9a4dc0a2d7b72af78832a4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:46.857415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c731fa91114cbebe4754e6e26ab756'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.857415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c731fa91114cbebe4754e6e26ab756'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.858260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:46.860104 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:46.870002 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c731fa91114cbebe4754e6e26ab756'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.889720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c731fa91114cbebe4754e6e26ab756'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.890894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c731fa91114cbebe4754e6e26ab756'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:46.928080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:46.933500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb789a-6db7-4c92-9872-5fd6ee7bcde4 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:46.938681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:46.939333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:46.939614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:46.939919 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] PATH_INFO: `/v3/users/e7378b96b8994984a359ac62a9593f06` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:46.941250 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7378b96b8994984a359ac62a9593f06)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:46.943183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.009127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1297/2560] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:46 2022] DELETE /identity/v3/users/60c731fa91114cbebe4754e6e26ab756 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:47.178022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7378b96b8994984a359ac62a9593f06'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.178682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7378b96b8994984a359ac62a9593f06'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.185607 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7378b96b8994984a359ac62a9593f06'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.186257 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7378b96b8994984a359ac62a9593f06'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.198116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7378b96b8994984a359ac62a9593f06'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.251148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.252876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.284063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1264/2561] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:46 2022] DELETE /identity/v3/users/e7378b96b8994984a359ac62a9593f06 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:47.322715 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a7e6-da3d-4132-aaec-e7a243a9af25 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.379794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.380340 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.380638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.380910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] PATH_INFO: `/v3/projects/45e421dfad1d4c92ae0937dd3282ac82` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.382041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e421dfad1d4c92ae0937dd3282ac82)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:47.383950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.509548 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:47.518730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e421dfad1d4c92ae0937dd3282ac82', 'request_id': 'req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.523984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e421dfad1d4c92ae0937dd3282ac82', 'request_id': 'req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.538124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.539906 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.557041 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90916-6621-43bf-bd63-746f700cbad8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.603102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e421dfad1d4c92ae0937dd3282ac82', 'request_id': 'req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.615256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] The token cache is being invalidate because project 45e421dfad1d4c92ae0937dd3282ac82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:47.615570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.616197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-bc5931f3-4589-4e03-aaa5-fbd1aaf45771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.617329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.617722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1298/2562] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:47 2022] DELETE /identity/v3/projects/45e421dfad1d4c92ae0937dd3282ac82 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:47.618649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.618939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.619219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] PATH_INFO: `/v3/projects/073b355043f34fadab52e33e4dd1b7a8` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.620418 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073b355043f34fadab52e33e4dd1b7a8)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:47.622527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.622647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782b74-2961-40ab-b8e9-23200d2848f8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.622898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782b74-2961-40ab-b8e9-23200d2848f8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.623352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4782b74-2961-40ab-b8e9-23200d2848f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.644049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-a4782b74-2961-40ab-b8e9-23200d2848f8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:47.645190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a4782b74-2961-40ab-b8e9-23200d2848f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.653537 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1299/2563] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:47.661784 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.662065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.662338 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.681778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:47.682990 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.695044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1300/2564] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:47.696046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.706578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a21a4-384e-4e79-9d2f-92c2109e90e1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.711676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.712291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.712573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.712869 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.713527 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:00:47.714097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:47.715824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.730669 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1301/2565] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 11:00:47.735285 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.746221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbc00-3b6d-43af-a68b-1b5f22282894 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.756971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073b355043f34fadab52e33e4dd1b7a8', 'request_id': 'req-71ae1d56-462e-46e1-a573-bd20fd198176'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.763378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073b355043f34fadab52e33e4dd1b7a8', 'request_id': 'req-71ae1d56-462e-46e1-a573-bd20fd198176'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.806915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.807520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.807799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.808071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.808781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:47.810662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.834329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073b355043f34fadab52e33e4dd1b7a8', 'request_id': 'req-71ae1d56-462e-46e1-a573-bd20fd198176'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.846950 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] The token cache is being invalidate because project 073b355043f34fadab52e33e4dd1b7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:47.847240 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.847871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-71ae1d56-462e-46e1-a573-bd20fd198176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:47.849384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1265/2566] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:47 2022] DELETE /identity/v3/projects/073b355043f34fadab52e33e4dd1b7a8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:47.854119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cd615-c8c9-408e-9cbb-eb1d41521b6f None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.854395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cd615-c8c9-408e-9cbb-eb1d41521b6f None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.854661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cd615-c8c9-408e-9cbb-eb1d41521b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.863414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:47.874516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f47cd615-c8c9-408e-9cbb-eb1d41521b6f None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:47.875782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f47cd615-c8c9-408e-9cbb-eb1d41521b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.884264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1266/2567] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:47.892291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.892569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.892869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.905457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1302/2568] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:47.909191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.910989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.912404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:47.913684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:47.976687 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1267/2569] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:47.979378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718f0a-8cd0-460b-8e60-70d554642530 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.981338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:47.984164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.985437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.985745 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.986015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.986670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:47.988700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:47.991911 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f00a0-28a2-4a86-98fb-13d8d45327ea None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:47.996567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:47.997364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:47.999936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:47.999936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:47.999936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:00:47.999936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.001150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.012506 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1268/2570] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 11:00:48.016713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.025886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fad83a-c299-4781-8717-cfbc7e36a9a1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.031356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.031966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.034027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.034027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.034027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.035063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.092253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1303/2571] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:47 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:48.096252 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.105858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa09c82-bd9c-470a-9d2c-6492df81701a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.111211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.111803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.112082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.112351 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.113035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.114630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.120151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:48.126163 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1304/2572] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:48.130064 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.130518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1269/2573] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:00:48 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:00:48.134281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.140379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91542e21-bbd9-4ce0-b3cd-08ae508f17d0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.201260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.201995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.202377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.202742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.204169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.205917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.207588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8533b-2150-4de7-a0c9-0e7a5fa70d7b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.212499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.213321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.213894 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.214166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.214796 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.216740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1305/2574] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:48.216874 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.221480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.232729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa00698-16f8-4465-8e91-609a6263a630 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.238555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.239219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.239524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.239820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] PATH_INFO: `/v3/projects/1357293771dc4433b2784faebd559dad/users/0e333875e69e44d0a3a995f333f37df5/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.257106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1357293771dc4433b2784faebd559dad, user_id=0e333875e69e44d0a3a995f333f37df5, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.259787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c71f4f-b677-4dbd-a968-f9308b31e264 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.381780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1270/2575] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:00:48 2022] POST /identity/v3/users => generated 281 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:00:48.385750 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.395866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b695de-7a97-4d3d-85ab-8e614d7fbe52 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.400514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.401118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.401402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.401675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.402299 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.403869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.413870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1271/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:48.417122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1306/2577] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:48 2022] PUT /identity/v3/projects/1357293771dc4433b2784faebd559dad/users/0e333875e69e44d0a3a995f333f37df5/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:48.425345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.428347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.428729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.429005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.435508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4cdf5-b3cb-4229-adee-1cc4d7c4b0f8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.459061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] MFA Rules not processed for user `0e333875e69e44d0a3a995f333f37df5`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:48.460276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:48.477219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:48.493678 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.494280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.494559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.494827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.495466 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.497098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.511186 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1272/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:00:48.512219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.522727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fed1b-3d42-445b-9d41-a5b9b4407bf1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.526845 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1307/2579] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:48.527595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.528243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.528526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.529083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] PATH_INFO: `/v3/projects/b88e32ab940f4b0297e24873e9f4967b/users/f7c9313035dd4f5d8298ece71649e76d/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.538009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.539467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:48.545521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88e32ab940f4b0297e24873e9f4967b, user_id=f7c9313035dd4f5d8298ece71649e76d, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.548728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b534-9fc0-44aa-ad2d-5d72342755f6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.596248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8f51c-fd22-407d-9c7e-682e114e60c2 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.599860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.600460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.600773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.601042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.609129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.610626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.615296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1273/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:00:48 2022] PUT /identity/v3/projects/b88e32ab940f4b0297e24873e9f4967b/users/f7c9313035dd4f5d8298ece71649e76d/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:00:48.619630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1308/2581] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:00:48.626713 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.626999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.627273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.656187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] MFA Rules not processed for user `f7c9313035dd4f5d8298ece71649e76d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:48.658030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:48.725939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1274/2582] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:48.768953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.771632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:48.779030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:48.783672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46d35-dbca-475e-9d60-ac16f7fa7b16 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.840167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.841061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.841349 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.841622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.851280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.852794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4fb3e-b13a-4113-9e0f-383b4d7a0e03 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:48.862665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1309/2583] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:48.879932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:48.946067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc174-f16d-40bc-a883-e85daf096295 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:48.950793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:48.951519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:48.951804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:48.952078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] PATH_INFO: `/v3/users/f7c9313035dd4f5d8298ece71649e76d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:48.957284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c9313035dd4f5d8298ece71649e76d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:48.957284 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:49.221802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:49.223399 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c9313035dd4f5d8298ece71649e76d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:49.227469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c9313035dd4f5d8298ece71649e76d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:49.231030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c9313035dd4f5d8298ece71649e76d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:49.231663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c9313035dd4f5d8298ece71649e76d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:49.243425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c9313035dd4f5d8298ece71649e76d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:49.347935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1275/2584] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:48 2022] DELETE /identity/v3/users/f7c9313035dd4f5d8298ece71649e76d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:49.353725 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:49.354646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:49.355185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:49.376779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:49.381098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:49.441460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1310/2585] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:00:49.451872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:49.454450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:49.512899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22253575-ca34-45f8-ab66-5831833002cc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:49.517105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:49.517711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:49.517988 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:49.518260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:49.527382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:49.528838 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:49.538679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1276/2586] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:00:50.065095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:50.066590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:50.079342 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0cef2-92b3-455e-8ae1-73cf16098a17 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:50.090631 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:50.091321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:50.091608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:50.091919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] PATH_INFO: `/v3/projects/b88e32ab940f4b0297e24873e9f4967b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:50.093173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88e32ab940f4b0297e24873e9f4967b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:50.095359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:50.217425 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88e32ab940f4b0297e24873e9f4967b', 'request_id': 'req-9cd02161-f053-4ba1-80f0-2c31f1f89633'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:50.223772 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88e32ab940f4b0297e24873e9f4967b', 'request_id': 'req-9cd02161-f053-4ba1-80f0-2c31f1f89633'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:50.320397 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88e32ab940f4b0297e24873e9f4967b', 'request_id': 'req-9cd02161-f053-4ba1-80f0-2c31f1f89633'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:50.332986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] The token cache is being invalidate because project b88e32ab940f4b0297e24873e9f4967b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:00:50.333276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:50.333911 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:50.335392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1311/2587] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:50 2022] DELETE /identity/v3/projects/b88e32ab940f4b0297e24873e9f4967b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:55.571613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:55.573117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:55.585283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2c63c-741e-404d-8200-fc9b049b8744 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:55.634505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:55.635110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:55.635398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:55.635673 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:55.637462 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:55.701975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:55.704180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba329e-d9a2-4aa2-ab82-caf25b66dbe9 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:55.715018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1277/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:58.691073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:58.692549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:58.731081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:58.763589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd02161-f053-4ba1-80f0-2c31f1f89633 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:58.769817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:58.770474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:58.770929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:58.771204 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] PATH_INFO: `/v3/users/0e333875e69e44d0a3a995f333f37df5` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:58.772427 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e333875e69e44d0a3a995f333f37df5)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:58.774420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:58.983282 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e333875e69e44d0a3a995f333f37df5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:58.984027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e333875e69e44d0a3a995f333f37df5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:58.991567 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e333875e69e44d0a3a995f333f37df5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:59.003299 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e333875e69e44d0a3a995f333f37df5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:59.003961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e333875e69e44d0a3a995f333f37df5'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:59.121082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1312/2589] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:00:58 2022] DELETE /identity/v3/users/0e333875e69e44d0a3a995f333f37df5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:00:59.126861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:59.127394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:59.127394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:59.147054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:00:59.148241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:59.158695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:00:59.208359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1278/2590] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:00:59.219153 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:59.220580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:59.277130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f85a01-468f-4bf6-b01c-e2941adb8507 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:59.280723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:59.282151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:59.282446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:59.282963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:59.293037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:59.294478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f733c-dd71-4699-912d-c697a041a316 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:59.304098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1313/2591] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:00:59.743813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:00:59.745308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:00:59.760662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d6cc7-487c-4320-9055-ebe0680118d1 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:00:59.766099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:00:59.766738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:00:59.767015 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:00:59.767316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] PATH_INFO: `/v3/projects/1357293771dc4433b2784faebd559dad` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:00:59.769163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1357293771dc4433b2784faebd559dad)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:00:59.771488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:00:59.942108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1357293771dc4433b2784faebd559dad', 'request_id': 'req-d82e2d33-46c6-4510-97b3-6a41751bb50f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:00:59.947929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1357293771dc4433b2784faebd559dad', 'request_id': 'req-d82e2d33-46c6-4510-97b3-6a41751bb50f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:00.016358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1357293771dc4433b2784faebd559dad', 'request_id': 'req-d82e2d33-46c6-4510-97b3-6a41751bb50f'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:00.028502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] The token cache is being invalidate because project 1357293771dc4433b2784faebd559dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:00.028823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:00.029493 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d82e2d33-46c6-4510-97b3-6a41751bb50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:00.032238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1279/2592] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:00:59 2022] DELETE /identity/v3/projects/1357293771dc4433b2784faebd559dad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:00.037101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.037559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.037654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.058755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:00.060017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:00.108377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:00.120649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1314/2593] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:00.128767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.129289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.129289 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.149705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:00.156411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:00.162548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1280/2594] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:00.166764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.177768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b9e74-df21-4ea2-97dc-283774b2effb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.182675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.190491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.198905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1315/2595] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 11:01:00.204562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.214341 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9682-7332-4ff3-a8fe-4a03bf569dbd None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.219446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.220134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.220484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.220794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.221444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.223339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.338248 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1281/2596] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:00.342544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.352447 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856f6b-3051-4c19-88d3-856205d36ae3 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.409479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.410070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.410348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.410616 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.411267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.413225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.600653 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1316/2597] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:00.604742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.615947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba407b-665f-493f-bd2f-8c8147c8b8fb admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.620567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.621312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.621591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.621864 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.622520 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.624110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.635690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1282/2598] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:00.639855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.650521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef1540-e28a-405f-9312-bd4c50a1a160 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.655276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.655941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.656244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.656849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.657503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.659116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac2144-90c3-4958-9ee5-0f7bce2961aa admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.669918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1317/2599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:00.692732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.703094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b676a-a01a-458f-903a-c9f2e52857fc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:00.708177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:00.708866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.709167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.709434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] PATH_INFO: `/v3/projects/c6aca0cf5eed43fc87841e20288b091a/users/302d1947cf724b7d85e9f70d00ae92d1/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.725333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aca0cf5eed43fc87841e20288b091a, user_id=302d1947cf724b7d85e9f70d00ae92d1, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:00.727984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:00.840487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1283/2600] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:00 2022] PUT /identity/v3/projects/c6aca0cf5eed43fc87841e20288b091a/users/302d1947cf724b7d85e9f70d00ae92d1/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:00.851390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:00.851617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:00.851887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:00.881059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] MFA Rules not processed for user `302d1947cf724b7d85e9f70d00ae92d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:00.884264 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:00.945599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1318/2601] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:00.950580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:00.991304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:01.013562 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b778dd-80d7-4803-87f6-267c78367584 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.018365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.018965 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.019243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.019517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.020188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.022187 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.126566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1284/2602] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:00 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:01.130709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.141468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196f5e-6688-496c-9f5b-667206787d1a None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.185552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:01.197558 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.202177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.202177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.202177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.202177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.202177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.303133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1319/2603] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:01 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:01.307416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.318615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a1afe-e9e3-4df5-afe8-e6b38cf9bef4 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.323322 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.323916 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.324232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.324504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.325172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.326752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.337152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1285/2604] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:01.341406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.352249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e0d5-bb9d-4ab1-b338-84f53b40bf5e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.356856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.357546 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.357824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.358094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] PATH_INFO: `/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e/users/840fa7c4108e435296d56d222bb48324/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.372637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae11fa7cc8040c3a8810a6dc191232e, user_id=840fa7c4108e435296d56d222bb48324, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.376266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.457655 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1320/2605] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:01 2022] PUT /identity/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e/users/840fa7c4108e435296d56d222bb48324/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:01.461690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.473091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398af93-58ef-49b3-8c22-2a326aa9d205 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.527947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.528544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.528853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.529123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.529755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.531968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad668ea-323a-4393-95b7-56a121a4f612 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.541491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1286/2606] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:01.545624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.556008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807a66e-bc05-4229-a7ce-1bbd35fc30f0 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.560933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.561630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.561910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.562249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] PATH_INFO: `/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e/users/840fa7c4108e435296d56d222bb48324/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.564177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae11fa7cc8040c3a8810a6dc191232e, user_id=840fa7c4108e435296d56d222bb48324, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.566937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.577110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1321/2607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:01 2022] PUT /identity/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e/users/840fa7c4108e435296d56d222bb48324/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:01.589372 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.589791 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.590071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.618198 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] MFA Rules not processed for user `840fa7c4108e435296d56d222bb48324`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:01.619405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:01.686724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1287/2608] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:01.698458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:01.700267 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:01.760126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfdf6b-82f9-43b9-9c4b-8bab738b1018 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:01.763785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:01.764386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:01.764692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:01.764966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:01.774203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:01.775643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:01.785671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1322/2609] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:02.059645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:02.070142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d889-4e50-4f0c-b6f8-d8f450bd7b9e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:02.073714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:02.074311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:02.074591 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:02.074862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:02.105702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:02.134543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:02.136030 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:02.144875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1288/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:11.781280 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:12.188733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=14 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:14.172524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:14.174208 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:14.231065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a986c-4ee4-4481-b115-ea13fad42107 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:14.234963 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:14.235559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:14.235831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:14.236102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:14.237924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:14.299377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:14.300851 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2efa05-ed2b-4c9d-82d7-c446d02b695f service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:14.310685 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1323/2611] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:14.332463 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:14.344643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fb63a-4d75-4716-8374-f3053e4394ac service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:14.349443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:14.350070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:14.350347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:14.350620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] PATH_INFO: `/v3/users/302d1947cf724b7d85e9f70d00ae92d1` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:14.351870 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] RBAC: Authorizing `identity:delete_user(user_id=302d1947cf724b7d85e9f70d00ae92d1)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:14.353822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:14.579784 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302d1947cf724b7d85e9f70d00ae92d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:14.580432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302d1947cf724b7d85e9f70d00ae92d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:14.587876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302d1947cf724b7d85e9f70d00ae92d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:14.588555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302d1947cf724b7d85e9f70d00ae92d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:14.601012 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302d1947cf724b7d85e9f70d00ae92d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:14.694775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1289/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:14 2022] DELETE /identity/v3/users/302d1947cf724b7d85e9f70d00ae92d1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:14.699255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:14.699553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:14.699889 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:14.721212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:14.722454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:14.783114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1324/2613] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:14.794172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:14.795669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:14.858110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21b2a2-e812-4520-90f3-1dcd1d06587f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:14.862835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:14.864527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:14.864872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:14.865151 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:14.876301 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:14.877780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:14.887957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1290/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:15.479327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:15.481027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:15.516180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8f66-2cbc-48d7-9ebe-9826934ce7d8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:15.521933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:15.522785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:15.523155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:15.523539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] PATH_INFO: `/v3/projects/c6aca0cf5eed43fc87841e20288b091a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:15.524895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6aca0cf5eed43fc87841e20288b091a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:15.526945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:15.658167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:15.660880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6aca0cf5eed43fc87841e20288b091a', 'request_id': 'req-2e6f4e8f-05a0-4cac-a312-3c597d924272'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:15.666330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6aca0cf5eed43fc87841e20288b091a', 'request_id': 'req-2e6f4e8f-05a0-4cac-a312-3c597d924272'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:15.783061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6aca0cf5eed43fc87841e20288b091a', 'request_id': 'req-2e6f4e8f-05a0-4cac-a312-3c597d924272'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:15.796454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] The token cache is being invalidate because project c6aca0cf5eed43fc87841e20288b091a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:15.797238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:15.797954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:15.799489 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1325/2615] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:15 2022] DELETE /identity/v3/projects/c6aca0cf5eed43fc87841e20288b091a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:15.803615 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:15.815782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da6ce-2f8b-4dea-a79b-8dee23b4cd23 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:15.883066 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:15.883716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:15.884001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:15.884275 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] PATH_INFO: `/v3/users/840fa7c4108e435296d56d222bb48324` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:15.885480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=840fa7c4108e435296d56d222bb48324)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:15.887497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:15.906238 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:16.870825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840fa7c4108e435296d56d222bb48324'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:16.871503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840fa7c4108e435296d56d222bb48324'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:16.878782 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840fa7c4108e435296d56d222bb48324'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:16.879442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840fa7c4108e435296d56d222bb48324'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:16.893014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-715f276f-8b1b-4df4-8e8d-0c5a01bd4ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840fa7c4108e435296d56d222bb48324'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:17.004381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1291/2616] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:15 2022] DELETE /identity/v3/users/840fa7c4108e435296d56d222bb48324 => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:17.663141 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:17.664649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:17.681966 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f4e8f-05a0-4cac-a312-3c597d924272 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:17.747700 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:17.748696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:17.749040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:17.749309 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] PATH_INFO: `/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:17.750454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae11fa7cc8040c3a8810a6dc191232e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:17.752375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:17.867049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae11fa7cc8040c3a8810a6dc191232e', 'request_id': 'req-b07c079f-1270-4edf-a914-96382476f59e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:17.875101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae11fa7cc8040c3a8810a6dc191232e', 'request_id': 'req-b07c079f-1270-4edf-a914-96382476f59e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:17.969866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae11fa7cc8040c3a8810a6dc191232e', 'request_id': 'req-b07c079f-1270-4edf-a914-96382476f59e'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.001840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] The token cache is being invalidate because project 4ae11fa7cc8040c3a8810a6dc191232e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:18.002218 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.002970 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-b07c079f-1270-4edf-a914-96382476f59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.007446 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1326/2617] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:17 2022] DELETE /identity/v3/projects/4ae11fa7cc8040c3a8810a6dc191232e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:18.010024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.010953 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.011232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.034720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:18.036142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:18.109508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1292/2618] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:18.116850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.117757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.118067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.140239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:18.141601 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:18.149849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1327/2619] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:18.153921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.164458 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca94571-7507-4725-a390-e0d99eca42e4 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.169742 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.170484 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.170670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.171133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.171802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:18.172106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.174176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.187013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1293/2620] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:01:18.191554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.201688 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46c54-d3f6-4651-b1ec-b16bd919d296 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.208917 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.209543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.209821 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.210087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.210742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.212755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.320568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1328/2621] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:18.322966 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.335149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac23ed-b172-46fd-8de1-4d4b79366d3f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.405671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.406352 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.406633 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.406921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.408008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.411155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.541029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1294/2622] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:18.543928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.555337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc28c2-c20e-4939-9cd8-9cf78d1801d7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.559934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.560538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.560848 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.561116 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.562525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.564115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.574844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1329/2623] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:18.578308 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.588333 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843df78-ed96-4d37-93c1-92667f275f76 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.593353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.593928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.594207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.594485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.595152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.596773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.603613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:18.607929 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1295/2624] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:18.612505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.622482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a5904-c9cf-4dda-a9e1-8f41fa4dc8e6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.628281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.628969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.629281 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.629555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] PATH_INFO: `/v3/projects/4323e9481dd2434db2c099b1e5388af8/users/940511eb77014d9c8503b6a628ac4e66/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.643860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.643860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:18.646270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4323e9481dd2434db2c099b1e5388af8, user_id=940511eb77014d9c8503b6a628ac4e66, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.649021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d1d1-0be8-4c56-8a2c-bdc6d2ef68f9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.657337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e38195-a9bf-4fd9-a8ea-abd8c059ffe7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.662503 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.663237 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.663899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.664226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] PATH_INFO: `/v3/users/aa80a09a986646ab98a5cfdac813bd8d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.665419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa80a09a986646ab98a5cfdac813bd8d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.667359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.721322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:18.726197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1330/2625] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:18 2022] PUT /identity/v3/projects/4323e9481dd2434db2c099b1e5388af8/users/940511eb77014d9c8503b6a628ac4e66/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:18.737997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.738277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.738543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.766275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] MFA Rules not processed for user `940511eb77014d9c8503b6a628ac4e66`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:18.767476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:18.830379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1331/2626] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:18.834696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:18.892035 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa80a09a986646ab98a5cfdac813bd8d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.892805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa80a09a986646ab98a5cfdac813bd8d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.897799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a515984-30a9-4901-b65e-03f6df796e78 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:18.899649 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa80a09a986646ab98a5cfdac813bd8d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.900357 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa80a09a986646ab98a5cfdac813bd8d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:18.902498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:18.903106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:18.903388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:18.903667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:18.904450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:18.906891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:18.912871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa80a09a986646ab98a5cfdac813bd8d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.039574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1296/2627] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:18 2022] DELETE /identity/v3/users/aa80a09a986646ab98a5cfdac813bd8d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:19.069775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1332/2628] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:18 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:19.071093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.072543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.145497 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3662-1359-4cdc-889c-8cb7ed96c5bc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.205172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.205792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.206072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.206343 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.206976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.208939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.305079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1297/2629] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:19 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:19.312898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.312898 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.313924 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.321659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadf19-3a82-4488-bcaf-4b8a65232bee admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.325918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248737d6-57f1-4bef-938f-2acfc73ed85f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.330526 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.331224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.331575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.331854 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.332023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.332194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.332358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.332503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] PATH_INFO: `/v3/projects/80137f0c580e46d990b8bd7df0aa6e1a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.333434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.334048 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80137f0c580e46d990b8bd7df0aa6e1a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.335024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.337104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.341529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:19.347488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1298/2630] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:19.351500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.363366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f32258-ac4f-4cc9-9d7c-8e83de161ab9 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.368771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.369438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.369712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.369995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] PATH_INFO: `/v3/projects/4a328347f8884daf9a11092d32214412/users/1bebfe08c7e3451781e81fa7137c2f23/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.386436 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a328347f8884daf9a11092d32214412, user_id=1bebfe08c7e3451781e81fa7137c2f23, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.389115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.514756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1299/2631] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:19 2022] PUT /identity/v3/projects/4a328347f8884daf9a11092d32214412/users/1bebfe08c7e3451781e81fa7137c2f23/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:19.518536 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.522788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80137f0c580e46d990b8bd7df0aa6e1a', 'request_id': 'req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.528268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80137f0c580e46d990b8bd7df0aa6e1a', 'request_id': 'req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.582077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368144c-c87b-4019-a0b6-24eee46d142e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.639218 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.639853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.640276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.640554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.641232 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.642825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.652548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1300/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:01:19.656820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.657419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80137f0c580e46d990b8bd7df0aa6e1a', 'request_id': 'req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.665228 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:19.666543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07205245-cdf2-4ac7-a0fc-73a634d16048 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.669524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] The token cache is being invalidate because project 80137f0c580e46d990b8bd7df0aa6e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:19.669819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.670458 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-e61973ba-dbb2-48a6-8e0f-0bd4f572cec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:19.672472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.672856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1333/2633] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:19 2022] DELETE /identity/v3/projects/80137f0c580e46d990b8bd7df0aa6e1a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:19.673163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.673444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.673747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] PATH_INFO: `/v3/projects/4a328347f8884daf9a11092d32214412/users/1bebfe08c7e3451781e81fa7137c2f23/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.675786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a328347f8884daf9a11092d32214412, user_id=1bebfe08c7e3451781e81fa7137c2f23, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.677648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1e473-0984-4044-afca-e6e17bb5c8b2 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.677915 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1e473-0984-4044-afca-e6e17bb5c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.678184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1e473-0984-4044-afca-e6e17bb5c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.678443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474fcc2-6a3b-438a-baaf-60d109907e77 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.689675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1301/2634] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:19 2022] PUT /identity/v3/projects/4a328347f8884daf9a11092d32214412/users/1bebfe08c7e3451781e81fa7137c2f23/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:19.699727 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.699871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-77b1e473-0984-4044-afca-e6e17bb5c8b2 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:19.700074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.700264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.701007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-77b1e473-0984-4044-afca-e6e17bb5c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.730656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] MFA Rules not processed for user `1bebfe08c7e3451781e81fa7137c2f23`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:19.734383 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.778350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1334/2635] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:19.787551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:19.788377 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.789022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.789022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.808665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1302/2636] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:19.813742 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:19.815102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.820715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.822053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:19.823555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1335/2637] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:19.828621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.837133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e3d73-f918-43ff-875a-f99934c983e9 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.842198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.843308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.843723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.844820 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.845547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:19.845852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.848457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:19.861574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1336/2638] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:01:19.866289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:19.877503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6417a1-75e8-41c9-9cce-16cc0f2f7403 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:19.882866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:19.883620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:19.883948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:19.884221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:19.884928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:19.888833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.002880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204a3b0-b4c2-42d9-a907-3c1eabb94e18 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.006381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.006977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.007251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.007572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.016578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.018002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.021464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1337/2639] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:19 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:20.022453 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.027766 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1303/2640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:20.096084 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdebcd-cc01-49c4-a3b6-1608c231c621 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.097802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.099340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:20.101101 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.101709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.101987 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.102268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.102894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.104871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.113167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aaab4-b030-4498-abf2-2b93c2955c57 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.118010 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.118641 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.118898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.119167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] PATH_INFO: `/v3/users/940511eb77014d9c8503b6a628ac4e66` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.120274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=940511eb77014d9c8503b6a628ac4e66)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.122195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.221409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1338/2641] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:20 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:20.225667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.235251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd68f-991a-44f1-b322-481b51243d8d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.239831 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.240403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.240724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.240996 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.241622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.246434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.253375 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1339/2642] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:01:20.257263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.267557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607708-54e5-400e-9f25-199fd60410dd admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.272078 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.275224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.275224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.275224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.275224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.275580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.285973 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1340/2643] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:01:20.289798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.299419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61d203-7dd2-4b78-87c0-5827eaca578e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.303975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.304572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.304878 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.305148 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] PATH_INFO: `/v3/projects/e6822751c04b4494ad22dc80877bcf36/users/8d304e2ae9f84d268c362e040658983b/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.319712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6822751c04b4494ad22dc80877bcf36, user_id=8d304e2ae9f84d268c362e040658983b, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.322371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7792ea-0d45-4e36-a4a6-4c1237f0dc3f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.345386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940511eb77014d9c8503b6a628ac4e66'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:20.346059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940511eb77014d9c8503b6a628ac4e66'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:20.353094 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940511eb77014d9c8503b6a628ac4e66'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:20.353724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940511eb77014d9c8503b6a628ac4e66'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:20.365313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-2c52b8d8-75aa-4f1f-b604-89e3f6039fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940511eb77014d9c8503b6a628ac4e66'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:20.421959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:20.426750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1341/2644] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:20 2022] PUT /identity/v3/projects/e6822751c04b4494ad22dc80877bcf36/users/8d304e2ae9f84d268c362e040658983b/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:20.431874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.432157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.432432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.451391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:20.453232 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:20.462816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1304/2645] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:20 2022] DELETE /identity/v3/users/940511eb77014d9c8503b6a628ac4e66 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:20.467580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.468061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.468369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.487124 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:20.488368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:20.513693 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1342/2646] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:20.524708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.526079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:20.553568 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1305/2647] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:20.563702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:20.565075 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:20.571440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:20.585906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d70ca-37ab-447c-ada6-c2dbfd9f8960 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.621228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51cd45-0a19-4d0b-9300-ba1af0867965 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:20.625602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.626220 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.626489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.626758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.633854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:20.634490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:20.635491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:20.635758 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:20.636051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.637523 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.645916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:20.647401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:20.647816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1306/2648] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:20.657592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1343/2649] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:21.144622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:21.146123 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:21.165313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec531a-6cbd-459c-a56f-265fa365a86a service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:21.171491 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:21.172152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:21.172427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:21.172881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] PATH_INFO: `/v3/projects/4323e9481dd2434db2c099b1e5388af8` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:21.173905 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4323e9481dd2434db2c099b1e5388af8)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:21.175909 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:21.320991 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4323e9481dd2434db2c099b1e5388af8', 'request_id': 'req-0c39e95f-0287-4442-be73-c8276a852074'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.327326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4323e9481dd2434db2c099b1e5388af8', 'request_id': 'req-0c39e95f-0287-4442-be73-c8276a852074'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.428215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4323e9481dd2434db2c099b1e5388af8', 'request_id': 'req-0c39e95f-0287-4442-be73-c8276a852074'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.441662 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] The token cache is being invalidate because project 4323e9481dd2434db2c099b1e5388af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:21.441958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.442627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.446008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1307/2650] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:21 2022] DELETE /identity/v3/projects/4323e9481dd2434db2c099b1e5388af8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:21.448435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:21.458881 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1241-3922-4fb2-806c-da422ccd6f65 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:21.517098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:21.517762 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:21.518039 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:21.518307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] PATH_INFO: `/v3/users/1bebfe08c7e3451781e81fa7137c2f23` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:21.519412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bebfe08c7e3451781e81fa7137c2f23)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:21.521390 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:21.522926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=100 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:21.739827 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bebfe08c7e3451781e81fa7137c2f23'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.740487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bebfe08c7e3451781e81fa7137c2f23'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.747572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bebfe08c7e3451781e81fa7137c2f23'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.760696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bebfe08c7e3451781e81fa7137c2f23'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.763654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-7484227d-dd3d-4a11-bf9b-6910957692a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bebfe08c7e3451781e81fa7137c2f23'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:21.880393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1344/2651] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:21 2022] DELETE /identity/v3/users/1bebfe08c7e3451781e81fa7137c2f23 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:22.373028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:22.381989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:22.387932 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e95f-0287-4442-be73-c8276a852074 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:22.453949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:22.454590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:22.455128 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:22.456422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] PATH_INFO: `/v3/projects/4a328347f8884daf9a11092d32214412` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:22.458478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a328347f8884daf9a11092d32214412)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:22.459567 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:22.588514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:22.603380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a328347f8884daf9a11092d32214412', 'request_id': 'req-167f5022-7488-4766-ba27-1cfa53cd4622'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:22.609877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a328347f8884daf9a11092d32214412', 'request_id': 'req-167f5022-7488-4766-ba27-1cfa53cd4622'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:22.771822 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a328347f8884daf9a11092d32214412', 'request_id': 'req-167f5022-7488-4766-ba27-1cfa53cd4622'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:22.785371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] The token cache is being invalidate because project 4a328347f8884daf9a11092d32214412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:22.785681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:22.786342 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-167f5022-7488-4766-ba27-1cfa53cd4622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:22.791315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1308/2652] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:22 2022] DELETE /identity/v3/projects/4a328347f8884daf9a11092d32214412 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:22.793201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:22.793712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:22.793805 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:22.817500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:22.819105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:22.898806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1345/2653] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:22.900475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:22.900785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:22.901058 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:22.926989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:22.926989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:22.932046 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1309/2654] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:22.936867 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:22.946775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877400-1683-44ce-8beb-11f0bf9762c3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:22.958994 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:22.961371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:22.961371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:22.961371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:22.961371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:22.961808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:22.963480 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:22.976645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1346/2655] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:01:22.981003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:22.990715 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11c943-a767-4ea8-9635-e61e34bd2c94 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:22.995840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.001525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.001525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.001525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.001525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.001525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.120443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1310/2656] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:22 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:23.123712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.136041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a48f9-99fa-4fd0-8422-a253131a4cc8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:23.209864 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.210483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.210764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.211037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.211684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.213674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.228053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:23.337350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1347/2657] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:23 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:23.341696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.352915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545ecd0-540b-40df-b063-b41bbf88e4d7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:23.362699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.363326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.363605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.363877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.364528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.366211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.377572 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1311/2658] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:23.381733 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.391736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2835010-8b3c-4f43-b526-008f4382caed admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:23.396366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.396998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.397275 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.397542 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.398175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.399767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3ade-58f7-49f2-bebd-77228a1ef68b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.410244 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1348/2659] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:23.414315 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.425110 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda01b6-06b5-4517-9931-c84138148a8b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:23.429695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.430334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.430612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.431196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] PATH_INFO: `/v3/projects/55b95e52413748f4b1111f952f68b20b/users/985d5062bcb8440e9357bbd7cd36d937/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.448368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b95e52413748f4b1111f952f68b20b, user_id=985d5062bcb8440e9357bbd7cd36d937, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.451179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.586387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1312/2660] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:23 2022] PUT /identity/v3/projects/55b95e52413748f4b1111f952f68b20b/users/985d5062bcb8440e9357bbd7cd36d937/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:23.599012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398def-df94-48ab-894d-833911345084 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.599315 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398def-df94-48ab-894d-833911345084 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.599592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398def-df94-48ab-894d-833911345084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.628344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-60398def-df94-48ab-894d-833911345084 None None] MFA Rules not processed for user `985d5062bcb8440e9357bbd7cd36d937`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:23.629677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-60398def-df94-48ab-894d-833911345084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:23.694050 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1349/2661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:23.698583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.788072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff4ea-3336-4bef-bf0f-89ad1431894d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:23.794753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:23.800166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:23.800166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:23.800166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:23.800166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:23.800166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:23.904349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1313/2662] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:23 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:23.915538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398def-df94-48ab-894d-833911345084 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:23.928877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398def-df94-48ab-894d-833911345084 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.005979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.006641 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.006914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.007184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.007836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.009838 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:24.174384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1350/2663] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:23 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:24.180764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:24.192235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959ae64-a617-44d4-8c86-28544948becf admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.196889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.197627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.198335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.198335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.199055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.200798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:24.215682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1314/2664] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:24.217125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:24.228704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5fb4-c8ee-4d4b-a53b-477c16c37f40 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.233740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.243517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.243517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.243517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.243517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.243517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14538b-36cf-4f07-84d4-8ed33f9747ca admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:24.249177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1351/2665] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:24.253394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:24.263826 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b2fb-88ec-424a-bd31-31c941c47a0e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.269188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.269860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.270135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.270413 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] PATH_INFO: `/v3/projects/b6983715768a49dc902b59165f9d2258/users/16e13936164045489dfdcc2035bca665/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.286048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6983715768a49dc902b59165f9d2258, user_id=16e13936164045489dfdcc2035bca665, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.288840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:24.444501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1315/2666] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:24 2022] PUT /identity/v3/projects/b6983715768a49dc902b59165f9d2258/users/16e13936164045489dfdcc2035bca665/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:24.455746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.456145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.456518 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.490258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] MFA Rules not processed for user `16e13936164045489dfdcc2035bca665`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:24.491022 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:24.567152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1352/2667] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:24.571717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:24.585979 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:24.647773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292f6b7-a769-4549-92c2-44d8c0db7cb1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.652865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.653485 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.653759 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.654026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.654684 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.656853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:24.680454 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:24.782469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:24.788797 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1316/2668] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:24 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:24.794509 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed68f2-849c-46fe-9011-dc315d9e758b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:24.853928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:24.854703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:24.855125 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:24.855395 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:24.856031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:24.858512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.050161 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1353/2669] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:24 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:25.054203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:25.066731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4418e-6ee2-4892-ac14-2e077beb83ce admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:25.071405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:25.072038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.072425 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.072743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.073416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:25.075008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.088451 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1317/2670] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:25.099573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:25.110599 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22ad96-631a-4008-8cf9-2a111f9a48a9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:25.115256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:25.116032 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.116317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.116600 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] PATH_INFO: `/v3/projects/8d20e24e32874191b441abb3afeb9167/users/902e9e15f8b14859b240f2f4ddbe3b15/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.134079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d20e24e32874191b441abb3afeb9167, user_id=902e9e15f8b14859b240f2f4ddbe3b15, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:25.136993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.259139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1354/2671] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:25 2022] PUT /identity/v3/projects/8d20e24e32874191b441abb3afeb9167/users/902e9e15f8b14859b240f2f4ddbe3b15/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:25.262937 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:25.273922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f96640-d8a3-423e-9ce0-6d7ab45cbf97 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:25.343637 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:25.344318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.344608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.344910 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.345555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:25.347172 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f937-5ef1-4bf3-91d5-c779817ed166 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.364029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:25.364928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1318/2672] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:01:25.375132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ce1a-eecc-483c-8b47-f03c41b51605 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:25.379960 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:25.380651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.380933 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.381741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] PATH_INFO: `/v3/projects/8d20e24e32874191b441abb3afeb9167/users/902e9e15f8b14859b240f2f4ddbe3b15/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.383749 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d20e24e32874191b441abb3afeb9167, user_id=902e9e15f8b14859b240f2f4ddbe3b15, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:25.386704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.405184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1355/2673] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:25 2022] PUT /identity/v3/projects/8d20e24e32874191b441abb3afeb9167/users/902e9e15f8b14859b240f2f4ddbe3b15/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:25.409643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819c5b-d4a5-4ccb-80fa-091734de439a None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.417217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819c5b-d4a5-4ccb-80fa-091734de439a None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.417217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819c5b-d4a5-4ccb-80fa-091734de439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.441081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4c819c5b-d4a5-4ccb-80fa-091734de439a None None] MFA Rules not processed for user `902e9e15f8b14859b240f2f4ddbe3b15`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:25.442459 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4c819c5b-d4a5-4ccb-80fa-091734de439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:25.513358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1319/2674] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:25.524543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:25.526330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:25.593536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99476-4904-499b-bca6-76321ce4b119 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:25.597266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:25.597871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:25.598146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:25.598411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:25.607924 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:25.609913 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:25.628981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1356/2675] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:26.847345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:26.847856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:26.847856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:26.855837 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:26.885900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] MFA Rules not processed for user `8d304e2ae9f84d268c362e040658983b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:26.886309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:26.960973 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1320/2676] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:26.985182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:26.985182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:27.031572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:27.056708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:27.058182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:27.069316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f1399-635a-4d08-a5a8-1708a4a0e071 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:27.071630 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96986ed-c45b-489a-93ee-0358491d64c1 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:27.075332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:27.075516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:27.076092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:27.076287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:27.076419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:27.076561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:27.076836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:27.077260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:27.086516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:27.088782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8af84f-d662-4f26-8c29-665fbd3bd4ef service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:27.099344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1357/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:27.141499 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:27.142931 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:27.152529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1321/2678] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:30.445502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:30.446014 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:30.446146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:30.469550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] MFA Rules not processed for user `8d304e2ae9f84d268c362e040658983b`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:30.477833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:30.481712 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1358/2679] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:32.810092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:32.820527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482774c3-fc12-41e8-a629-4e0505fa9692 service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:32.824405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:32.826277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:32.826277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:32.826277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:32.883052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:32.884471 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08bf1d-c632-4a81-9881-70cefaa9d2fb service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:32.893505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1322/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:37.540239 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:37.602347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ade76d-44a6-4988-960e-650c5681a46e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:37.606877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:37.607541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:37.607843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:37.608119 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] PATH_INFO: `/v3/users/985d5062bcb8440e9357bbd7cd36d937` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:37.609268 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985d5062bcb8440e9357bbd7cd36d937)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:37.611225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:37.816732 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985d5062bcb8440e9357bbd7cd36d937'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:37.817408 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985d5062bcb8440e9357bbd7cd36d937'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:37.824411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985d5062bcb8440e9357bbd7cd36d937'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:37.837216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985d5062bcb8440e9357bbd7cd36d937'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:37.837861 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985d5062bcb8440e9357bbd7cd36d937'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:37.918575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1359/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:37 2022] DELETE /identity/v3/users/985d5062bcb8440e9357bbd7cd36d937 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:01:37.923108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:37.925440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:37.925440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:37.942648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:37.943827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:37.969202 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:38.002583 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1323/2682] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:38.012379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:38.014430 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:38.054272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:38.071490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a531de1-6bf2-4be9-b208-c72ba3b8df68 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:38.075120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:38.075718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:38.075997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:38.076308 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:38.085304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:38.086728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:38.096997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1360/2683] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:38.536450 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:38.537951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:38.550956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19f13-163c-41e0-9ad8-853abd623726 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:38.555584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:38.556215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:38.556486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:38.556785 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] PATH_INFO: `/v3/projects/55b95e52413748f4b1111f952f68b20b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:38.557890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b95e52413748f4b1111f952f68b20b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:38.559780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:38.666517 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b95e52413748f4b1111f952f68b20b', 'request_id': 'req-8af75ce2-32f2-485b-b24d-43e31fad6638'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:38.672815 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b95e52413748f4b1111f952f68b20b', 'request_id': 'req-8af75ce2-32f2-485b-b24d-43e31fad6638'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:38.776469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b95e52413748f4b1111f952f68b20b', 'request_id': 'req-8af75ce2-32f2-485b-b24d-43e31fad6638'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:38.801985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] The token cache is being invalidate because project 55b95e52413748f4b1111f952f68b20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:38.802320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:38.802957 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:38.804478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1324/2684] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:38 2022] DELETE /identity/v3/projects/55b95e52413748f4b1111f952f68b20b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:38.808431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:38.860331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28f59-311d-499c-af87-91b9941f81ef service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:38.916382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:38.917068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:38.917347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:38.917642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] PATH_INFO: `/v3/users/16e13936164045489dfdcc2035bca665` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:38.918776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e13936164045489dfdcc2035bca665)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:38.920782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:39.161051 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e13936164045489dfdcc2035bca665'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:39.161738 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e13936164045489dfdcc2035bca665'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:39.168726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e13936164045489dfdcc2035bca665'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:39.180314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e13936164045489dfdcc2035bca665'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:39.180967 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e13936164045489dfdcc2035bca665'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:39.318818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1361/2685] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:38 2022] DELETE /identity/v3/users/16e13936164045489dfdcc2035bca665 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:39.738438 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:39.740214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:39.811414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75ce2-32f2-485b-b24d-43e31fad6638 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:39.867328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:39.867879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:39.868156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:39.868427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] PATH_INFO: `/v3/projects/b6983715768a49dc902b59165f9d2258` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:39.869648 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6983715768a49dc902b59165f9d2258)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:39.876268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:39.876268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:40.009077 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6983715768a49dc902b59165f9d2258', 'request_id': 'req-a4d92b54-ddb8-416f-a9d4-de08494520b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.015968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6983715768a49dc902b59165f9d2258', 'request_id': 'req-a4d92b54-ddb8-416f-a9d4-de08494520b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.128268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6983715768a49dc902b59165f9d2258', 'request_id': 'req-a4d92b54-ddb8-416f-a9d4-de08494520b1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.139634 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] The token cache is being invalidate because project b6983715768a49dc902b59165f9d2258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:40.146006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.146006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.146006 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1325/2686] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:39 2022] DELETE /identity/v3/projects/b6983715768a49dc902b59165f9d2258 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:40.146452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:40.147662 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:40.161300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934823f-4a2c-45c6-9d93-fbf1de58c00d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:40.174074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:40.217908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:40.218530 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:40.218804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:40.219073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] PATH_INFO: `/v3/users/902e9e15f8b14859b240f2f4ddbe3b15` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:40.220175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902e9e15f8b14859b240f2f4ddbe3b15)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:40.222185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:40.487894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902e9e15f8b14859b240f2f4ddbe3b15'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.488553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902e9e15f8b14859b240f2f4ddbe3b15'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.495949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902e9e15f8b14859b240f2f4ddbe3b15'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.508553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902e9e15f8b14859b240f2f4ddbe3b15'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.509344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-94f9188f-2bc2-422d-8f9c-04d5b0861e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902e9e15f8b14859b240f2f4ddbe3b15'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:40.605322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1362/2687] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:40 2022] DELETE /identity/v3/users/902e9e15f8b14859b240f2f4ddbe3b15 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:41.188624 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:41.190083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:41.203740 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d92b54-ddb8-416f-a9d4-de08494520b1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:41.266057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:41.266703 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.266985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.267261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] PATH_INFO: `/v3/projects/8d20e24e32874191b441abb3afeb9167` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.268404 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d20e24e32874191b441abb3afeb9167)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:41.270531 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:41.415884 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d20e24e32874191b441abb3afeb9167', 'request_id': 'req-9dc53914-eda8-443f-a576-a8becf51bab4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:41.421600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d20e24e32874191b441abb3afeb9167', 'request_id': 'req-9dc53914-eda8-443f-a576-a8becf51bab4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:41.502244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d20e24e32874191b441abb3afeb9167', 'request_id': 'req-9dc53914-eda8-443f-a576-a8becf51bab4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:41.514217 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] The token cache is being invalidate because project 8d20e24e32874191b441abb3afeb9167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:41.514358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:41.514977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-9dc53914-eda8-443f-a576-a8becf51bab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:41.516574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1326/2688] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:41 2022] DELETE /identity/v3/projects/8d20e24e32874191b441abb3afeb9167 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:41.522492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.522969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.523067 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.581158 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:41.582358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:41.652657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1363/2689] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:41.660668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.660958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.661180 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.682072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:41.683318 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:41.692839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1327/2690] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:41.697151 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:41.709326 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881bf05-3c0a-42db-ae64-3a2d56a9c441 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:41.715152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:41.715614 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.715919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.716195 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.717133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:41.717999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:41.719516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:41.721376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:41.732424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1364/2691] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:01:41.737082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:41.746456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735233-0d23-42cb-b0bf-4b807bac9906 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:41.752805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:41.753540 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.753681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.753936 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.754595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:41.756481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:41.768155 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:41.866636 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1328/2692] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:41 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:41.870993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:41.881235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac640d-b114-4f24-a8a9-cac6ec5e4363 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:41.938799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:41.939400 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:41.939676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:41.939941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:41.940679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:41.942603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:42.025589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1365/2693] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:41 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:42.030655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:42.041115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd97530-4063-42d6-88fb-9c81ff363a6b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:42.045753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:42.046349 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:42.046631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:42.046901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:42.047538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:42.049177 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:42.058925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1329/2694] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:42.063056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:42.072948 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385807-aa84-42fe-a6c0-986016077a30 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:42.078150 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:42.078739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:42.079018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:42.079289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:42.079931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:42.081557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b356c0-45fe-4e34-83ee-dac232a392d9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:42.093188 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1366/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:42.097380 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:42.107255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21fc92-7d3b-4063-94a5-10afa8d21cba admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:42.112578 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:42.115956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:42.115956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:42.115956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] PATH_INFO: `/v3/projects/a700adf977914d72931845fef4706c5e/users/51630b1d8e9745fcbc7864a6aea1baec/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:42.128003 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a700adf977914d72931845fef4706c5e, user_id=51630b1d8e9745fcbc7864a6aea1baec, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:42.130712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:42.267922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1330/2696] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:42 2022] PUT /identity/v3/projects/a700adf977914d72931845fef4706c5e/users/51630b1d8e9745fcbc7864a6aea1baec/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:42.279320 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:42.279503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:42.279776 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:42.306580 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] MFA Rules not processed for user `51630b1d8e9745fcbc7864a6aea1baec`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:42.307788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:42.371379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1367/2697] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:42.383293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:42.385050 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:42.457105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6c661-02f9-4be1-bf2a-a95cc849ceca admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:42.461385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:42.461984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:42.462256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:42.462524 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:42.471082 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:42.472490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:42.481159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1331/2698] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:48.100535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:48.101995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:48.170435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:48.198487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae855be-5903-4750-a48e-ee26b2f08ca7 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:48.203766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:48.204422 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:48.204674 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:48.204945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:48.206659 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:48.220438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:48.222132 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6b846-eb36-4f91-8e25-638001c9f72b service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:48.234043 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1368/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:01:52.477175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:52.694428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:52.760674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b68e-c8f7-42e3-bfc2-a6969837d05b service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:52.766060 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:52.766716 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:52.766992 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:52.767282 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] PATH_INFO: `/v3/users/51630b1d8e9745fcbc7864a6aea1baec` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:52.768387 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51630b1d8e9745fcbc7864a6aea1baec)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:52.770402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:53.040667 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51630b1d8e9745fcbc7864a6aea1baec'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:53.041245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51630b1d8e9745fcbc7864a6aea1baec'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:53.048539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51630b1d8e9745fcbc7864a6aea1baec'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:53.049188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51630b1d8e9745fcbc7864a6aea1baec'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:53.061001 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51630b1d8e9745fcbc7864a6aea1baec'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:53.193273 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1332/2700] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:01:52 2022] DELETE /identity/v3/users/51630b1d8e9745fcbc7864a6aea1baec => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:53.197964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:53.198444 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:53.198628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:53.219057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:53.221183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:53.285222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1369/2701] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:53.296081 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:53.297918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:53.361733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db80718-4ea0-41e2-bfbd-4a3ed7890fb2 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:53.366013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:53.366654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:53.366933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:53.367207 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:53.376709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:53.378129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223781a-0553-4197-9d8f-76214804bee2 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:53.388053 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1333/2702] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:01:53.898352 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:53.900560 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:53.913319 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54349c82-6e64-45b6-b956-73f407ff3e46 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:53.918028 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:53.918660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:53.918940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:53.919212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] PATH_INFO: `/v3/projects/a700adf977914d72931845fef4706c5e` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:53.920438 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a700adf977914d72931845fef4706c5e)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:53.922385 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.055958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a700adf977914d72931845fef4706c5e', 'request_id': 'req-f84ee34a-e532-4668-b42a-a08192765145'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:54.061824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a700adf977914d72931845fef4706c5e', 'request_id': 'req-f84ee34a-e532-4668-b42a-a08192765145'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:54.176172 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a700adf977914d72931845fef4706c5e', 'request_id': 'req-f84ee34a-e532-4668-b42a-a08192765145'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:54.188905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] The token cache is being invalidate because project a700adf977914d72931845fef4706c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:01:54.189191 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:54.189930 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f84ee34a-e532-4668-b42a-a08192765145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:01:54.191492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1370/2703] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:01:53 2022] DELETE /identity/v3/projects/a700adf977914d72931845fef4706c5e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:54.196384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.196922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.197029 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.217690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:54.218889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:54.235525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:54.277331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1334/2704] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:01:54.345442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.346049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.346049 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.367577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:54.368824 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:54.378954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1371/2705] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:54.382706 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.393433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bf40b-53fc-4dc6-8604-66ed494bf609 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.398026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.398619 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.398898 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.399274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.399921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:01:54.400274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.401933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.413309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1335/2706] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:01:54.417578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.426817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db087-9b53-4701-b679-339b3ec4daba None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.431402 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.434592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.434592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.434592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.434592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.435578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.583440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1372/2707] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:01:54 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:01:54.587614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.597907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24361232-d803-409c-b91a-a1840ac17261 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.656760 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.657376 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.657651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.657917 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.658556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.660603 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.765300 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1336/2708] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:01:54 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:01:54.769534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.780159 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23395e-a107-4879-877f-7fd4f5f74bef admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.785198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.785835 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.786111 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.786379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.787083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.788757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.800194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1373/2709] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:54.804264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.815158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97334b3-23e0-4f74-9763-054bc947737b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.819676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.820351 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.820720 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.821105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.821915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.823496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80516-306d-442b-b343-8637e4aec5d9 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:54.834390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1337/2710] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:01:54.838894 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:54.849677 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef0a7-a2ca-485f-81a6-6845c4725ea9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:54.854497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:54.855136 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:54.855416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:54.855691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] PATH_INFO: `/v3/projects/fc1bf2ede6c14ed3975f87c3d66f9bdf/users/26ef00f8bbb7418a8fbe60a7d569bfde/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:54.868029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:01:54.871107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1bf2ede6c14ed3975f87c3d66f9bdf, user_id=26ef00f8bbb7418a8fbe60a7d569bfde, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:54.874588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:55.331149 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1374/2711] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:01:54 2022] PUT /identity/v3/projects/fc1bf2ede6c14ed3975f87c3d66f9bdf/users/26ef00f8bbb7418a8fbe60a7d569bfde/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:01:55.341386 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:55.342051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:55.342051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:55.369371 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] MFA Rules not processed for user `26ef00f8bbb7418a8fbe60a7d569bfde`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:01:55.370689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:55.437242 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1338/2712] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:01:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:01:55.448354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:01:55.450145 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:01:55.507376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddcf7-5137-4123-aaad-9f71c74e85a9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:01:55.511033 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:01:55.511634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:01:55.511939 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:01:55.512235 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:01:55.520695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:01:55.522127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029016b-98f4-4a10-a41d-f8b8480cd67b service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:01:55.531238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1375/2713] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:01:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:02:05.433131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:05.526936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:19.401908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:19.466661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f2b1c-8481-4d02-92a9-0711e68cb610 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:19.471230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:19.471901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:19.472176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:19.472444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] PATH_INFO: `/v3/users/26ef00f8bbb7418a8fbe60a7d569bfde` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:19.473627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ef00f8bbb7418a8fbe60a7d569bfde)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:19.475565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:19.782896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ef00f8bbb7418a8fbe60a7d569bfde'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:19.783877 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ef00f8bbb7418a8fbe60a7d569bfde'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:19.791592 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ef00f8bbb7418a8fbe60a7d569bfde'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:19.792221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ef00f8bbb7418a8fbe60a7d569bfde'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:19.805101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ef00f8bbb7418a8fbe60a7d569bfde'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:19.899052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1339/2714] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:02:19 2022] DELETE /identity/v3/users/26ef00f8bbb7418a8fbe60a7d569bfde => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:02:19.904181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:19.904678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:19.904796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:19.924242 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:19.925508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:19.984392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1376/2715] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:19.994120 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:19.995509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:20.072819 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8828f3-eb54-4c8b-8e2e-6677b72e268d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:20.077143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:20.077730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:20.078004 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:20.078277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:20.086980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:20.088370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475dbf9-22e1-483f-8e6f-0774f9d58b8f service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:20.098781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1340/2716] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:02:20.552713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:20.558401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:20.567394 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7548a14-deea-4ba9-8b0a-f73c1b065b33 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:20.572135 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:20.572804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:20.573082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:20.573353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] PATH_INFO: `/v3/projects/fc1bf2ede6c14ed3975f87c3d66f9bdf` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:20.574475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1bf2ede6c14ed3975f87c3d66f9bdf)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:20.577241 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:20.739416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1bf2ede6c14ed3975f87c3d66f9bdf', 'request_id': 'req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:20.744739 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1bf2ede6c14ed3975f87c3d66f9bdf', 'request_id': 'req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:20.866673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1bf2ede6c14ed3975f87c3d66f9bdf', 'request_id': 'req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:20.878773 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] The token cache is being invalidate because project fc1bf2ede6c14ed3975f87c3d66f9bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:02:20.879099 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:20.879726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-eb58e7d7-6510-4a3f-b5ac-6229a3c11e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:02:20.881224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1377/2717] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:02:20 2022] DELETE /identity/v3/projects/fc1bf2ede6c14ed3975f87c3d66f9bdf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:02:20.890834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:20.891309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:20.891421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:20.898900 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:20.911119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:20.912305 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:20.971810 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1341/2718] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:20.980708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:20.982388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:20.982388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.003210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:21.004434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:21.012391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1378/2719] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:21.016718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.027014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a2eae-5ee8-43aa-89ef-14247a3f0f5d None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.031756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.032354 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.036725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.036725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.036725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:02:21.036725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.036725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.048074 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1342/2720] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:02:21.052490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.062842 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e004a1-ccb5-4733-b27d-8aa897c30ea0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.067491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.068081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.068357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.068646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.069270 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.071186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.177348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1379/2721] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:02:21 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:02:21.181690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.192565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a9259-8e16-43a9-bcd4-b64c4e460f3a admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.248747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.249347 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.249631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.249902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.250544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.252424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.404208 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1343/2722] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:02:21 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:02:21.408322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.420484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9c549-f4f5-442d-8bf5-96d62018a458 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.425465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.426062 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.426337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.426604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.427240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.428943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.439432 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1380/2723] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:02:21.443642 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.453853 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b66f-2d3e-41a5-bc85-82ae37b8e70c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.458550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.459147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.459428 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.459700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.460337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.461961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3a5d-dbb9-453c-93cf-c3f87a9f227c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.473280 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1344/2724] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:02:21.477353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.488076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693528-7dee-426b-927e-e326d6618d52 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.492569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.493240 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.493522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.493794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] PATH_INFO: `/v3/projects/bf69e0f785b747dc8726166b5186fc6f/users/d5f52b2310a84448879fc3e537a8a9c4/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.508197 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf69e0f785b747dc8726166b5186fc6f, user_id=d5f52b2310a84448879fc3e537a8a9c4, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.510892 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.617088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1381/2725] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:02:21 2022] PUT /identity/v3/projects/bf69e0f785b747dc8726166b5186fc6f/users/d5f52b2310a84448879fc3e537a8a9c4/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:02:21.622278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c1c0-5240-40f7-bee8-0319323ce0c0 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.622612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c1c0-5240-40f7-bee8-0319323ce0c0 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.622889 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997c1c0-5240-40f7-bee8-0319323ce0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.642205 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-1997c1c0-5240-40f7-bee8-0319323ce0c0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:21.643420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1997c1c0-5240-40f7-bee8-0319323ce0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:21.705590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1345/2726] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:21.715517 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:21.717362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:21.740578 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:21.777490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdfaf-120a-40c2-9198-f2d51a98c436 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:21.781764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:21.782369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:21.782642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:21.782908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:21.792035 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:21.793590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:21.803098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1382/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:02:23.326334 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83256-fd88-45db-97a0-7f2a66bd7877 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:23.326857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83256-fd88-45db-97a0-7f2a66bd7877 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:23.326998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83256-fd88-45db-97a0-7f2a66bd7877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:23.352115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:23.362831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-82d83256-fd88-45db-97a0-7f2a66bd7877 None None] MFA Rules not processed for user `d5f52b2310a84448879fc3e537a8a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:23.364014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-82d83256-fd88-45db-97a0-7f2a66bd7877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:23.436176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1346/2728] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:23.447661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:02:23.449081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:23.526875 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39800d84-1700-41bd-bec8-0c973cddd920 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:02:23.531479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:02:23.534164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:23.534164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:23.534164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:23.541222 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:02:23.542673 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb549-921e-4ceb-83a3-667e7b99041a service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:02:23.552931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1383/2729] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:02:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:02:25.695521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8135-48e7-47e4-98b2-9871061ec863 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:25.696095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8135-48e7-47e4-98b2-9871061ec863 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:25.696095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8135-48e7-47e4-98b2-9871061ec863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:25.715987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-b57a8135-48e7-47e4-98b2-9871061ec863 None None] MFA Rules not processed for user `d5f52b2310a84448879fc3e537a8a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:25.717145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b57a8135-48e7-47e4-98b2-9871061ec863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:25.723930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1347/2730] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:02:33.548475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=52 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:35.710118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=31 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:02:42.948682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911de03-19ba-4549-82c5-203930e7452e None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:02:42.949859 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911de03-19ba-4549-82c5-203930e7452e None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:02:42.949975 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911de03-19ba-4549-82c5-203930e7452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:02:42.971525 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3911de03-19ba-4549-82c5-203930e7452e None None] MFA Rules not processed for user `d5f52b2310a84448879fc3e537a8a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:02:42.972782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3911de03-19ba-4549-82c5-203930e7452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:02:42.979982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1384/2731] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:02:52.966334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:03:06.483938 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e5e6-b30e-4db3-811a-5f9234bd8125 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:06.484473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e5e6-b30e-4db3-811a-5f9234bd8125 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:06.484614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e5e6-b30e-4db3-811a-5f9234bd8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:06.514225 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c120e5e6-b30e-4db3-811a-5f9234bd8125 None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:03:06.515596 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c120e5e6-b30e-4db3-811a-5f9234bd8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:06.578119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1348/2732] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 5 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:03:06.727431 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911de03-19ba-4549-82c5-203930e7452e None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:06.728941 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3911de03-19ba-4549-82c5-203930e7452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:06.800559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911de03-19ba-4549-82c5-203930e7452e None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:06.805736 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:06.806347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:06.806623 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:06.806891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:06.814961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:06.816568 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1001e92-f706-4ecc-a8e8-9348e2e6fac7 service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:06.825102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1385/2733] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 11:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 11:03:14.560655 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d193e-9c0a-4065-9b1e-efb9408ef887 None None] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.561226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d193e-9c0a-4065-9b1e-efb9408ef887 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.561226 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d193e-9c0a-4065-9b1e-efb9408ef887 None None] PATH_INFO: `/` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:14.563219 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1349/2734] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 11:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 11:03:14.575635 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96cea-988c-4a62-9291-6e5393d874f1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.576656 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96cea-988c-4a62-9291-6e5393d874f1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.577138 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96cea-988c-4a62-9291-6e5393d874f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:14.612234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2ed96cea-988c-4a62-9291-6e5393d874f1 None None] MFA Rules not processed for user `80d508c497124391ad6e0ff77a534b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:03:14.613983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2ed96cea-988c-4a62-9291-6e5393d874f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:14.621764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1386/2735] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:03:14.640528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d193e-9c0a-4065-9b1e-efb9408ef887 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:14.658064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d193e-9c0a-4065-9b1e-efb9408ef887 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:14.665107 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:14.666143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.666707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.667233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:14.678105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:14.680021 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533a904-ae9d-420f-a574-f1809f60d52e service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:14.691481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1350/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:03:14.791305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.792988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.793510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] PATH_INFO: `/` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:14.795588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1387/2737] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 5 11:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 11:03:14.802133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707174a-f7e9-492f-8b0b-f048ceb5ee44 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.802410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707174a-f7e9-492f-8b0b-f048ceb5ee44 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.802682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707174a-f7e9-492f-8b0b-f048ceb5ee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:14.839777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-9707174a-f7e9-492f-8b0b-f048ceb5ee44 None None] MFA Rules not processed for user `a69da51c538a4e29ac81a774c36c4931`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:03:14.841606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-9707174a-f7e9-492f-8b0b-f048ceb5ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:14.945481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1351/2738] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 5 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:03:14.958087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:14.959981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:14.978466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897e2c-aad7-451f-a503-33fc2767c931 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:14.984937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:14.986256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:14.986812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:14.987508 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:15.004052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:15.005642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:15.020538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1388/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:03:24.939821 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=78 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:03:25.012951 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=41 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:03:25.290101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:25.290384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:25.290656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:25.310144 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] MFA Rules not processed for user `4b0dcea4fe9f4743900680142e94e505`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:03:25.311384 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:25.318643 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1352/2740] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 5 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:03:25.331229 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:25.343304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dccf4-8b55-4ac1-bbce-938ecd685f42 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:25.348798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38ca2939be224113a823b0bbba092f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:25.349391 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:25.349667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:25.349934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:25.357843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:25.359439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:25.367392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1389/2741] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 5 11:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 11:03:28.992424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:28.998661 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da238d6b-2753-4a42-afb5-e8b48388309e None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:29.003368 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:29.004061 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:29.004314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:29.004677 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] PATH_INFO: `/v3/users/d5f52b2310a84448879fc3e537a8a9c4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:29.005741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f52b2310a84448879fc3e537a8a9c4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:29.007748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:29.493705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f52b2310a84448879fc3e537a8a9c4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:29.495295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f52b2310a84448879fc3e537a8a9c4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:29.502780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f52b2310a84448879fc3e537a8a9c4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:29.503454 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f52b2310a84448879fc3e537a8a9c4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:29.521790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f52b2310a84448879fc3e537a8a9c4'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:29.610215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1353/2742] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:03:28 2022] DELETE /identity/v3/users/d5f52b2310a84448879fc3e537a8a9c4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:03:29.885359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:29.899216 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f572d-3469-43d2-a634-10fa22fa83ba service swift] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:29.968695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:29.969358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:29.974644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:29.974644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] PATH_INFO: `/v3/projects/bf69e0f785b747dc8726166b5186fc6f` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:29.974644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf69e0f785b747dc8726166b5186fc6f)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:29.974644 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:30.071697 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf69e0f785b747dc8726166b5186fc6f', 'request_id': 'req-a0011d5e-d4f7-4953-af5f-8c80ed29433d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:30.077221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf69e0f785b747dc8726166b5186fc6f', 'request_id': 'req-a0011d5e-d4f7-4953-af5f-8c80ed29433d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:30.128133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf69e0f785b747dc8726166b5186fc6f', 'request_id': 'req-a0011d5e-d4f7-4953-af5f-8c80ed29433d'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:30.140836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] The token cache is being invalidate because project bf69e0f785b747dc8726166b5186fc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:03:30.146621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:30.146621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:03:30.146621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1390/2743] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:03:29 2022] DELETE /identity/v3/projects/bf69e0f785b747dc8726166b5186fc6f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:03:36.206395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:36.207875 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:36.263998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b47d4-d410-4367-b661-458a856fd806 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:36.311795 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:36.312397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:36.312696 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:36.312969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:36.314721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:36.347764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:03:36.383203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:36.384686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6251f-4499-461d-9668-d3deaab1b175 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:36.396288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1354/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:03:37.584177 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:03:37.585605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:37.599029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011d5e-d4f7-4953-af5f-8c80ed29433d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:03:37.602679 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:03:37.603781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:03:37.604079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:03:37.604323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:03:37.606030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:03:37.619852 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:03:37.621304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:03:37.632055 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1391/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:03:46.482577 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=17 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:03:47.627210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:04:22.798224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:22.798739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:22.798739 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:22.821733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] MFA Rules not processed for user `8d304e2ae9f84d268c362e040658983b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:04:22.821733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:22.874749 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1355/2746] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:04:23.629005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:23.630486 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:23.702743 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffed2-4986-4d38-9eda-b4a4b465aab3 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:23.707860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:23.708468 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:23.708791 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:23.709087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:23.711796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:23.723747 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:23.725502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:23.736927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1392/2747] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:26.963840 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:26.965470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:26.979679 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ef349-8439-4457-be69-ab5e1cc6a671 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:26.985787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:26.986411 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:26.986719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:26.987002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:26.988790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:27.000027 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:27.001590 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:27.011530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1356/2748] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:27.824620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:27.826183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:27.842144 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d02c-34d5-4c41-be13-7fda34db5dcc service placement] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:27.848107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:27.848691 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:27.848968 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:27.849236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:27.851675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:27.864755 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:27.868452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:27.879605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1393/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:37.007574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=31 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:04:37.874873 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=38 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:04:45.238468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:45.253071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d991f0-6fdb-47b5-9513-114f56dc8380 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:45.259559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:45.260170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:45.260444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:45.261329 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:45.262478 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:45.278204 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:45.279786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:45.291197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1357/2750] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:54.160479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:54.173313 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5f81d-ab57-48ad-ac03-228854cbfd13 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:54.179592 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:54.180190 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:54.180470 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:54.180823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:54.182552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:54.195284 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:54.197305 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:54.208114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1394/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:55.287117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=6 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:04:57.368327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:57.378519 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9907c6-62fd-4d2e-88d6-30da9b2f6a73 service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:57.382431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:57.383025 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:57.383302 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:57.383569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:57.385427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:57.463902 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:57.465398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:57.488456 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1358/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:04:58.322714 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:58.324189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:58.339954 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99144eaa-1e7d-4cdd-98e8-11038f8c2818 service placement] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:58.345037 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:58.345730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:58.346009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:58.346303 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] PATH_INFO: `/v3/users/a822b44675bc4865adc50ae6ecc3da54` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:58.347434 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a822b44675bc4865adc50ae6ecc3da54)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:58.349413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:58.592895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a822b44675bc4865adc50ae6ecc3da54'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:58.593538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a822b44675bc4865adc50ae6ecc3da54'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:58.601130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a822b44675bc4865adc50ae6ecc3da54'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:58.612839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a822b44675bc4865adc50ae6ecc3da54'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:58.613497 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a822b44675bc4865adc50ae6ecc3da54'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:58.703993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1395/2753] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:04:58 2022] DELETE /identity/v3/users/a822b44675bc4865adc50ae6ecc3da54 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:04:59.517101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:59.517101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72267a-4566-4f43-a63a-462f20fe68cf service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:04:59.517101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:04:59.517101 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:04:59.518233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:04:59.518233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] PATH_INFO: `/v3/projects/d305869b257b4e2e83a6d45207d20cb9` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:04:59.518233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d305869b257b4e2e83a6d45207d20cb9)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:04:59.518233 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:04:59.811440 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd305869b257b4e2e83a6d45207d20cb9', 'request_id': 'req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:59.817893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd305869b257b4e2e83a6d45207d20cb9', 'request_id': 'req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:59.944283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd305869b257b4e2e83a6d45207d20cb9', 'request_id': 'req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:59.956221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] The token cache is being invalidate because project d305869b257b4e2e83a6d45207d20cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:04:59.956513 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:59.957227 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:04:59.958941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1359/2754] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:04:59 2022] DELETE /identity/v3/projects/d305869b257b4e2e83a6d45207d20cb9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:04:59.963307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:04:59.964771 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:04:59.979205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295356fa-0cf1-4cdf-bfd4-692a0348ac56 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:00.035344 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:00.035971 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:00.036253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:00.036522 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] PATH_INFO: `/v3/users/2072da8773504f7e88aeffb109906298` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:00.038273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2072da8773504f7e88aeffb109906298)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:00.040259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:00.237825 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2072da8773504f7e88aeffb109906298'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.238483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2072da8773504f7e88aeffb109906298'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.246026 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2072da8773504f7e88aeffb109906298'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.250410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:00.259238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2072da8773504f7e88aeffb109906298'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.260902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2072da8773504f7e88aeffb109906298'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.360665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1396/2755] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:04:59 2022] DELETE /identity/v3/users/2072da8773504f7e88aeffb109906298 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:00.660047 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:00.663388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:00.679788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1268-7a16-40dc-8bf8-66bdb3537c47 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:00.701084 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:00.738146 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:00.738778 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:00.739056 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:00.739326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] PATH_INFO: `/v3/projects/83aac642e1824f27bc68a330198854b2` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:00.740553 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83aac642e1824f27bc68a330198854b2)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:00.743040 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:00.899758 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83aac642e1824f27bc68a330198854b2', 'request_id': 'req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:00.905676 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83aac642e1824f27bc68a330198854b2', 'request_id': 'req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:01.012664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83aac642e1824f27bc68a330198854b2', 'request_id': 'req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:01.025114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] The token cache is being invalidate because project 83aac642e1824f27bc68a330198854b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:05:01.025448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:01.026150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:01.027700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1360/2756] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:05:00 2022] DELETE /identity/v3/projects/83aac642e1824f27bc68a330198854b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:10.452407 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:11.021314 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:46.042903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:46.042903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:46.050379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffb712-0dbb-4c60-affd-967629dd6bb6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:46.106625 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:46.107253 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:46.107538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:46.107856 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] PATH_INFO: `/v3/users/8d304e2ae9f84d268c362e040658983b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:46.109018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d304e2ae9f84d268c362e040658983b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:46.110955 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:46.403569 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d304e2ae9f84d268c362e040658983b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.404223 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d304e2ae9f84d268c362e040658983b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.411103 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d304e2ae9f84d268c362e040658983b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.424413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d304e2ae9f84d268c362e040658983b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.425291 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-03abbe8a-48d0-43a0-ad97-8f143ddb8acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d304e2ae9f84d268c362e040658983b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.513701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1397/2757] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:05:46 2022] DELETE /identity/v3/users/8d304e2ae9f84d268c362e040658983b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:46.785119 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:46.786731 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:46.800415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3e82-5aa3-40ae-bdb3-ea95f37c69e1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:46.857381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:46.858005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:46.858283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:46.858552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] PATH_INFO: `/v3/projects/e6822751c04b4494ad22dc80877bcf36` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:46.859690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6822751c04b4494ad22dc80877bcf36)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:46.861620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:46.990142 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6822751c04b4494ad22dc80877bcf36', 'request_id': 'req-47c6eaf6-734e-452a-afc9-be90b9a0b62c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:46.995518 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6822751c04b4494ad22dc80877bcf36', 'request_id': 'req-47c6eaf6-734e-452a-afc9-be90b9a0b62c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:47.057561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6822751c04b4494ad22dc80877bcf36', 'request_id': 'req-47c6eaf6-734e-452a-afc9-be90b9a0b62c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:47.069072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] The token cache is being invalidate because project e6822751c04b4494ad22dc80877bcf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:05:47.080891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:47.080891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-47c6eaf6-734e-452a-afc9-be90b9a0b62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:05:47.080891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1361/2758] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:05:46 2022] DELETE /identity/v3/projects/e6822751c04b4494ad22dc80877bcf36 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:47.081215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.081215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.081215 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.097152 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:05:47.098870 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:47.158053 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1398/2759] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:05:47.167546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.167827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.168095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.188034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:05:47.189268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:47.197345 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1362/2760] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:05:47.201649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.211603 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a595-eebb-4a21-a3fe-dde08d95ecc8 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.219561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.219561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.219561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.219561 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.219972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:05:47.219972 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.220619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.232799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1399/2761] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:05:47.236997 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.246817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da41a-5c1f-4d35-b9ed-3dcd088676fe None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.251555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.252145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.252422 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.252730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.253364 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.255239 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.378839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1363/2762] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:05:47.383001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.393249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceef413-ac36-46c1-9fd0-6e8a71cd4783 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.396944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:47.448668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.449263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.449540 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.449809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.450482 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.452788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.588774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1400/2763] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:05:47.593183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.603732 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbd14d-0313-4209-8161-246e3ec2c3a0 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.608358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.608983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.609262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.609532 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.610170 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.611755 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.622566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1364/2764] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:05:47.626475 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.637417 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8a351-3940-4e30-98d3-af8ba8c107d5 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.641998 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.650629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.650629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.650629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.650629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.650629 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4704-f9c5-4fbd-a21e-4c04a741d494 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.656296 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1401/2765] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:05:47.660281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.670321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021457ab-edb9-4c1a-9f21-682d0a61764b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.674857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.675492 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.675769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.676534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] PATH_INFO: `/v3/projects/0811a44e5c33445ebb917805d8fad3b9/users/4e090554d52946eaa7a4649dbf0677f7/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.690569 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0811a44e5c33445ebb917805d8fad3b9, user_id=4e090554d52946eaa7a4649dbf0677f7, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.693926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:47.806718 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1365/2766] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:05:47 2022] PUT /identity/v3/projects/0811a44e5c33445ebb917805d8fad3b9/users/4e090554d52946eaa7a4649dbf0677f7/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:47.816956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.817384 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.817660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.845571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] MFA Rules not processed for user `4e090554d52946eaa7a4649dbf0677f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:05:47.846815 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:47.911492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1402/2767] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:05:47.916168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:47.936533 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:47.980920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f417e-e415-40af-aa89-2806960b808e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:47.985600 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:47.986196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:47.986470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:47.986737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:47.987397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:47.989336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.150833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1366/2768] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:05:47 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:05:48.155047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.172203 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023209-cb45-4c7d-88b3-7c3580e3b4eb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.221817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.222457 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.222735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.223021 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.223940 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.225908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.366129 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1403/2769] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:05:48 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:05:48.370243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.380722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0474a4-d57c-4633-a2de-ffa142de61f7 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.385397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.390007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.390007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.390007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.390007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.390007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.399614 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1367/2770] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:05:48.403781 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.409982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:48.414346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c84613-9271-48f7-adcf-966651c7b678 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.418919 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.419557 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.419832 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.420102 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] PATH_INFO: `/v3/projects/bda7f54010f447899048fd713a74da94/users/3603253e32bb4068a7a1945d1b4d1697/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.434735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda7f54010f447899048fd713a74da94, user_id=3603253e32bb4068a7a1945d1b4d1697, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.437321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.554289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1404/2771] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:05:48 2022] PUT /identity/v3/projects/bda7f54010f447899048fd713a74da94/users/3603253e32bb4068a7a1945d1b4d1697/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:48.558434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.568861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950dbca-6ff9-4a6c-adc2-0dc9d5b6b5d5 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.625161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.625779 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.626037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.626311 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.626941 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.628508 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adcd39-57bf-4c71-90fd-746b8a2baa34 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.638707 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1368/2772] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:05:48.643065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.654175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c51b0-e711-4c8a-ab7b-ad5509487b27 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.658895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.659541 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.659818 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.660088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] PATH_INFO: `/v3/projects/bda7f54010f447899048fd713a74da94/users/3603253e32bb4068a7a1945d1b4d1697/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.662249 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda7f54010f447899048fd713a74da94, user_id=3603253e32bb4068a7a1945d1b4d1697, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.664956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.675041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1405/2773] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:05:48 2022] PUT /identity/v3/projects/bda7f54010f447899048fd713a74da94/users/3603253e32bb4068a7a1945d1b4d1697/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:05:48.685078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.685320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.685594 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.712879 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] MFA Rules not processed for user `3603253e32bb4068a7a1945d1b4d1697`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:05:48.714100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:48.780114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1369/2774] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:05:48.792029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:48.796236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:05:48.851251 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7958-a1c7-4c63-a244-9a368b7e2d8a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:48.854871 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:48.855471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:48.855750 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:48.856023 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:48.865661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:48.867098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:48.876413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1406/2775] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:05:49.152960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:05:49.163421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66e8f-fa4c-4465-ba8b-cd5b14695bde None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:05:49.167051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:05:49.167645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:05:49.167920 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:05:49.168215 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:05:49.177683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:49.225358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:05:49.226699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e718548-097b-43fa-99e6-3f945161c1a4 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:05:49.235612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1370/2776] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:05:58.872201 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:05:59.274869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=22 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:00.557649 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:00.620104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e3e0-d74a-43ff-86ee-1e8356468ffd service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:00.624638 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:00.625259 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:00.625534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:00.625829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] PATH_INFO: `/v3/users/4e090554d52946eaa7a4649dbf0677f7` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:00.626928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e090554d52946eaa7a4649dbf0677f7)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:00.629409 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:00.845359 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e090554d52946eaa7a4649dbf0677f7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:00.846005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e090554d52946eaa7a4649dbf0677f7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:00.853651 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e090554d52946eaa7a4649dbf0677f7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:00.868169 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e090554d52946eaa7a4649dbf0677f7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:00.869952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e090554d52946eaa7a4649dbf0677f7'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:00.955173 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1407/2777] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:00 2022] DELETE /identity/v3/users/4e090554d52946eaa7a4649dbf0677f7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:00.959873 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:00.960374 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:00.960627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:00.979769 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:00.981024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:01.041947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1371/2778] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:01.053066 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:01.054498 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:01.116162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1adae8-7b8b-4552-ba92-45062f9d5a8c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:01.120300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:01.120927 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:01.121211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:01.121553 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:01.131958 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:01.133442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:01.143381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1408/2779] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:01.629926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:01.631657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:01.643754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea3a1d-0c7e-40f3-b849-4b4dc3f097d8 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:01.648735 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:01.649378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:01.649652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:01.650038 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] PATH_INFO: `/v3/projects/0811a44e5c33445ebb917805d8fad3b9` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:01.651193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0811a44e5c33445ebb917805d8fad3b9)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:01.653131 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:01.772665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0811a44e5c33445ebb917805d8fad3b9', 'request_id': 'req-31ab50df-3c23-48f4-907b-4c1d515748d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:01.778479 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0811a44e5c33445ebb917805d8fad3b9', 'request_id': 'req-31ab50df-3c23-48f4-907b-4c1d515748d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:01.875095 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0811a44e5c33445ebb917805d8fad3b9', 'request_id': 'req-31ab50df-3c23-48f4-907b-4c1d515748d1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:01.887369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] The token cache is being invalidate because project 0811a44e5c33445ebb917805d8fad3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:01.887664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:01.888307 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:01.889818 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1372/2780] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:01 2022] DELETE /identity/v3/projects/0811a44e5c33445ebb917805d8fad3b9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:01.893778 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:01.903883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585181b0-685d-4555-b6e9-5c49b0320006 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:01.922645 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:01.962478 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:01.963107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:01.963381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:01.963648 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] PATH_INFO: `/v3/users/3603253e32bb4068a7a1945d1b4d1697` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:01.964803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3603253e32bb4068a7a1945d1b4d1697)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:01.966724 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:02.172936 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3603253e32bb4068a7a1945d1b4d1697'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:02.173590 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3603253e32bb4068a7a1945d1b4d1697'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:02.180822 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3603253e32bb4068a7a1945d1b4d1697'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:02.193405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3603253e32bb4068a7a1945d1b4d1697'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:02.194057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-4261bb9d-272c-49d0-80f5-d4c81e3e6acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3603253e32bb4068a7a1945d1b4d1697'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:02.296995 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1409/2781] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:01 2022] DELETE /identity/v3/users/3603253e32bb4068a7a1945d1b4d1697 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:02.795587 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:02.797153 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:02.810719 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab50df-3c23-48f4-907b-4c1d515748d1 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:02.870105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:02.870730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:02.871008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:02.871276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] PATH_INFO: `/v3/projects/bda7f54010f447899048fd713a74da94` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:02.872385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda7f54010f447899048fd713a74da94)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:02.874313 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:02.996114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:03.011617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda7f54010f447899048fd713a74da94', 'request_id': 'req-0146a643-a0c9-4f57-844f-2685b255faaa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:03.017031 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda7f54010f447899048fd713a74da94', 'request_id': 'req-0146a643-a0c9-4f57-844f-2685b255faaa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:03.108638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda7f54010f447899048fd713a74da94', 'request_id': 'req-0146a643-a0c9-4f57-844f-2685b255faaa'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:03.120337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] The token cache is being invalidate because project bda7f54010f447899048fd713a74da94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:03.120652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:03.121270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-0146a643-a0c9-4f57-844f-2685b255faaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:03.122738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1373/2782] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:02 2022] DELETE /identity/v3/projects/bda7f54010f447899048fd713a74da94 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:03.127583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.128060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.128181 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.148015 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:03.149262 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:03.208345 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1410/2783] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:03.216223 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfce84-c006-4714-8456-705559d002dc None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.216505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfce84-c006-4714-8456-705559d002dc None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.216805 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfce84-c006-4714-8456-705559d002dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.236878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c1dfce84-c006-4714-8456-705559d002dc None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:03.238080 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c1dfce84-c006-4714-8456-705559d002dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:03.246013 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1374/2784] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:03.250412 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.260105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d8bd-43d5-48ec-aeb2-2bb88b65b462 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.264678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.265266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.265539 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.265803 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.266436 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:06:03.266733 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.268317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.280052 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1411/2785] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:06:03.290844 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfce84-c006-4714-8456-705559d002dc None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.299989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfce84-c006-4714-8456-705559d002dc None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.305544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.306134 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.306403 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.306682 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.307303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.309231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.516032 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1375/2786] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:03.520868 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.530783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8444-dc6d-491f-8389-59852551d0b4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.556565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:03.586853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.587487 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.587764 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.588030 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.588670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.590576 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.697469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1412/2787] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:03.701645 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.712729 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748be2a6-6180-44db-8e26-853f6fb6ee02 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.717689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.718288 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.718563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.718833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.719468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.721090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.730975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1376/2788] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:03.734765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.744823 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a4fc-88da-4f9a-bc52-25b4dfb1d8a6 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.749538 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.750128 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.750406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.750699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.751337 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.752984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bc7c2-4d0e-4485-9f58-b7bfbc8b9dbf admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.763476 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1413/2789] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:03.767628 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:03.778196 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862ac2-de17-44aa-b5bf-d475a5dd2506 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:03.782901 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:03.783538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.783811 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.784078 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] PATH_INFO: `/v3/projects/cb73890b848041b986d0b6a75b98ea30/users/fae9fc1ce7064a91a735aef62bab0fd6/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.798405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb73890b848041b986d0b6a75b98ea30, user_id=fae9fc1ce7064a91a735aef62bab0fd6, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:03.801173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:03.874339 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1377/2790] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:03 2022] PUT /identity/v3/projects/cb73890b848041b986d0b6a75b98ea30/users/fae9fc1ce7064a91a735aef62bab0fd6/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:03.885317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:03.885668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:03.889514 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:03.914929 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] MFA Rules not processed for user `fae9fc1ce7064a91a735aef62bab0fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:03.916178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:03.982602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1414/2791] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:03.987245 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.049093 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857bc4b-40c5-483f-b090-a166493b0625 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.054292 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.054881 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.055159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.055430 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.056059 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.057976 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.144293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1378/2792] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:03 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:04.149098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.159702 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977cfb-ebb8-47cc-98e5-49078b04f1c3 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.215492 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.216090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.216367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.216660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.217555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.219467 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.314493 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1415/2793] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:04 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:04.318410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.328753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8ce3-7e1b-4894-9cff-3e522a29d10f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.333664 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.343109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.343109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.343109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.343109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.343109 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.348330 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1379/2794] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:04.352383 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.362416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a7bf-9f5c-4fb3-b020-0a83be7f56f9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.367591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.368225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.368501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.368804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] PATH_INFO: `/v3/projects/bb53a90547d44a748954c386db8dfc20/users/972f70e6a57a4a0a8056f2a8a0e0aa8b/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.383341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb53a90547d44a748954c386db8dfc20, user_id=972f70e6a57a4a0a8056f2a8a0e0aa8b, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.386007 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.502854 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1416/2795] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:04 2022] PUT /identity/v3/projects/bb53a90547d44a748954c386db8dfc20/users/972f70e6a57a4a0a8056f2a8a0e0aa8b/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:06:04.506775 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.516956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b65-bf7c-445e-bf59-52c4b6944778 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.537559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:04.574091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.574620 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.574899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.575171 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.575803 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.577416 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8a776-c75d-44b9-9058-7cd22539f319 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.587193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1380/2796] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:04.591401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.597814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:04.603582 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12039e94-514b-4206-88bc-5d38d005485b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.608420 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.609130 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.609413 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.609687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] PATH_INFO: `/v3/projects/bb53a90547d44a748954c386db8dfc20/users/972f70e6a57a4a0a8056f2a8a0e0aa8b/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.611618 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb53a90547d44a748954c386db8dfc20, user_id=972f70e6a57a4a0a8056f2a8a0e0aa8b, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.614897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.625060 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1417/2797] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:04 2022] PUT /identity/v3/projects/bb53a90547d44a748954c386db8dfc20/users/972f70e6a57a4a0a8056f2a8a0e0aa8b/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:04.637331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.637644 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.637923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.665798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] MFA Rules not processed for user `972f70e6a57a4a0a8056f2a8a0e0aa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:04.667014 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:04.736987 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1381/2798] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:04.748877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:04.750621 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:04.807502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc59cb-56f0-4b43-ab44-c0bf5d70f92a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:04.811164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:04.811767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:04.812044 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:04.812317 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:04.822029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:04.823464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97de3-2d1d-49ac-900a-8c702d933236 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:04.833001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1418/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:07.913332 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:07.975244 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dc561-eda3-4b2a-a3eb-ea0eea6f1283 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:07.979669 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:07.980290 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:07.980563 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:07.980862 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] PATH_INFO: `/v3/users/fae9fc1ce7064a91a735aef62bab0fd6` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:07.981970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae9fc1ce7064a91a735aef62bab0fd6)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:07.983880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:08.167861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae9fc1ce7064a91a735aef62bab0fd6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:08.168516 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae9fc1ce7064a91a735aef62bab0fd6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:08.169753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:08.176057 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae9fc1ce7064a91a735aef62bab0fd6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:08.176738 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae9fc1ce7064a91a735aef62bab0fd6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:08.188444 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae9fc1ce7064a91a735aef62bab0fd6'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:08.297392 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1382/2800] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:07 2022] DELETE /identity/v3/users/fae9fc1ce7064a91a735aef62bab0fd6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:08.302205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:08.302650 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:08.302748 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:08.322632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:08.323816 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:08.382196 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1419/2801] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:08.392105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:08.393654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:08.451595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55918a4-ff7c-4ff2-a125-d86bfb129939 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:08.455394 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:08.455998 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:08.456277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:08.456695 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:08.465721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:08.467406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:08.476788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1383/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 11:06:08.904193 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:08.905666 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:08.919676 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f012a-f4aa-45bf-8b8b-3554d1266e1b None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:08.924306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:08.925001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:08.925884 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:08.926770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] PATH_INFO: `/v3/projects/cb73890b848041b986d0b6a75b98ea30` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:08.928068 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb73890b848041b986d0b6a75b98ea30)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:08.930071 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:09.039473 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb73890b848041b986d0b6a75b98ea30', 'request_id': 'req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.045036 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb73890b848041b986d0b6a75b98ea30', 'request_id': 'req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.102283 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb73890b848041b986d0b6a75b98ea30', 'request_id': 'req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.113775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] The token cache is being invalidate because project cb73890b848041b986d0b6a75b98ea30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:09.114065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.114696 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.116183 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1420/2803] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:08 2022] DELETE /identity/v3/projects/cb73890b848041b986d0b6a75b98ea30 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:09.120234 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:09.130806 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce38a2a-4027-438e-97b1-b4c8dad43888 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:09.187193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:09.187772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:09.188043 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:09.188312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] PATH_INFO: `/v3/users/972f70e6a57a4a0a8056f2a8a0e0aa8b` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:09.189489 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972f70e6a57a4a0a8056f2a8a0e0aa8b)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:09.192173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:09.423958 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972f70e6a57a4a0a8056f2a8a0e0aa8b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.424665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972f70e6a57a4a0a8056f2a8a0e0aa8b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.432397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972f70e6a57a4a0a8056f2a8a0e0aa8b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.435092 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972f70e6a57a4a0a8056f2a8a0e0aa8b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.444150 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:09.446606 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-ee2bd061-98f3-48f0-96c8-d2f5618a31b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972f70e6a57a4a0a8056f2a8a0e0aa8b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:09.565468 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1384/2804] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:09 2022] DELETE /identity/v3/users/972f70e6a57a4a0a8056f2a8a0e0aa8b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:10.036978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.038547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:10.053419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c43ed-2c67-4237-9b7e-4309f2de2f77 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.065767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:10.110330 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.110961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.111237 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.111506 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] PATH_INFO: `/v3/projects/bb53a90547d44a748954c386db8dfc20` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.112668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb53a90547d44a748954c386db8dfc20)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.114706 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.223726 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb53a90547d44a748954c386db8dfc20', 'request_id': 'req-15a24600-ebec-4e29-ac19-255c11d603c4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:10.229063 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb53a90547d44a748954c386db8dfc20', 'request_id': 'req-15a24600-ebec-4e29-ac19-255c11d603c4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:10.365899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb53a90547d44a748954c386db8dfc20', 'request_id': 'req-15a24600-ebec-4e29-ac19-255c11d603c4'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:10.377588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] The token cache is being invalidate because project bb53a90547d44a748954c386db8dfc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:10.377865 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:10.379005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-15a24600-ebec-4e29-ac19-255c11d603c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:10.380642 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1421/2805] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:10 2022] DELETE /identity/v3/projects/bb53a90547d44a748954c386db8dfc20 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:10.385488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.385971 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.386090 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.406079 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:10.407278 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:10.467546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1385/2806] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:10.475554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.475834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.476104 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.495481 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:10.506121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:10.506121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1422/2807] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:10.509201 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.519665 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e75c0-4fd4-4961-aa27-3ffb6560bff6 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.524470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.525083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.525359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.525626 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.526268 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:06:10.526565 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.528135 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.539711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1386/2808] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:06:10.543858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.553961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f7a8b-181a-4e60-a31f-82c686724398 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.558908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.559505 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.559785 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.560057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.560770 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.562740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.693834 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1423/2809] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:10 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:10.697964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.708327 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62ecfe-4674-4386-9560-5ff0fe323909 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.764544 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.765173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.765442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.765710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.766337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.768221 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.886385 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1387/2810] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:10 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:10.890494 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.900800 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b118a-063e-4520-a981-6e482619068e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.905346 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.905937 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.906212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.906474 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.907107 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.908719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.918459 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1424/2811] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:10.922297 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.932918 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2b6b-d7c4-4c27-b0f3-46c6d9249bd6 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.937631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.938258 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.938537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.938808 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.939442 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.941847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af1022-bcd8-43fd-898a-515fecf9bf02 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:10.962166 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1388/2812] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:10.962969 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:10.967945 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46f055-41c2-49e4-a2de-2af7ed86897a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:10.972916 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:10.973581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:10.973855 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:10.974122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] PATH_INFO: `/v3/projects/3d5345c52c1149eab158536779214dfe/users/a3ba5eee18cb47e68bba271dfe328738/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:10.988810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5345c52c1149eab158536779214dfe, user_id=a3ba5eee18cb47e68bba271dfe328738, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:10.991442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.102952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1425/2813] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:10 2022] PUT /identity/v3/projects/3d5345c52c1149eab158536779214dfe/users/a3ba5eee18cb47e68bba271dfe328738/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:11.114122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.114406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.114680 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.141823 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] MFA Rules not processed for user `a3ba5eee18cb47e68bba271dfe328738`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:11.143034 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:11.184071 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:11.205863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1389/2814] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:11.210500 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.254826 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:11.271905 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1cd67-84d2-4991-b632-febedea6575d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.276721 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.278076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.278076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.278076 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.278535 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.280443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.367465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1426/2815] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:11 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:11.371502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.382326 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572e599-356c-4432-97b3-ffb9a289ca98 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.438725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.439390 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.439593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.439863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.440490 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.442465 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.555117 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1390/2816] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:11 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:11.558964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.569944 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228b52-df7f-4bbb-a25c-8dc1b05b1d82 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.574586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.575178 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.575479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.575754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.576516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.578164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.589171 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1427/2817] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:11.593453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.604631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95514e4e-b5e2-4d2a-9e00-ec0f3f5adb08 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.609291 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.609956 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.610235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.610511 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] PATH_INFO: `/v3/projects/9c27777238e140ac9d03e1f6c134e421/users/faa620824582454f98e4a0b569f80971/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.625369 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c27777238e140ac9d03e1f6c134e421, user_id=faa620824582454f98e4a0b569f80971, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.628063 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.720259 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1391/2818] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:11 2022] PUT /identity/v3/projects/9c27777238e140ac9d03e1f6c134e421/users/faa620824582454f98e4a0b569f80971/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:11.725046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.743278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63532f-59d8-40a0-ae36-1cc653034a1c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.800077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.800788 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.801070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.801341 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.802009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.803652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b39645-9be2-41b7-97af-010eae69a60d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.813829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1428/2819] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:11.818005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:11.828254 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cc3c-39f6-4de7-8dd8-6b5110e8c4bc admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:11.833951 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:11.834608 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.834915 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.835188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] PATH_INFO: `/v3/projects/9c27777238e140ac9d03e1f6c134e421/users/faa620824582454f98e4a0b569f80971/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.837154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c27777238e140ac9d03e1f6c134e421, user_id=faa620824582454f98e4a0b569f80971, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:11.839753 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:11.850772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1392/2820] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:11 2022] PUT /identity/v3/projects/9c27777238e140ac9d03e1f6c134e421/users/faa620824582454f98e4a0b569f80971/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:11.915146 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:11.915416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:11.915692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:11.945324 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] MFA Rules not processed for user `faa620824582454f98e4a0b569f80971`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:11.946549 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:12.015585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1429/2821] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:12.027191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:12.028913 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:12.086022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46cd6d-076b-411d-997b-c548ed353769 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:12.089632 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:12.090231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:12.090509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:12.090781 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:12.100295 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:12.101743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9aad8b-00a9-41cb-8365-00e251443331 service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:12.111122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1393/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:12.140008 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:12.183378 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:12.205604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efed9-2dda-479c-a2a3-4021e954eef1 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:12.210952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:12.222134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:12.222134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:12.222134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] PATH_INFO: `/v3/users/a3ba5eee18cb47e68bba271dfe328738` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:12.222134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ba5eee18cb47e68bba271dfe328738)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:12.222134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:12.517236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ba5eee18cb47e68bba271dfe328738'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:12.517879 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ba5eee18cb47e68bba271dfe328738'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:12.524922 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ba5eee18cb47e68bba271dfe328738'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:12.538155 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ba5eee18cb47e68bba271dfe328738'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:12.538808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ba5eee18cb47e68bba271dfe328738'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:12.633630 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1430/2823] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:12 2022] DELETE /identity/v3/users/a3ba5eee18cb47e68bba271dfe328738 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:12.638088 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:12.638585 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:12.638709 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:12.657534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:12.663865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:12.691545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:12.716798 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1394/2824] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:12.727219 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:12.728718 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:12.787956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e9785-6b05-42d1-8ee5-05444148b3a8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:12.791440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:12.792042 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:12.792316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:12.792583 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:12.802469 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:12.803903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:12.813306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1431/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:13.225400 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:13.226896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:13.241550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c10997-97d2-4a23-9137-a1d3ae7154ec None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:13.246470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:13.247182 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:13.256657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:13.256657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] PATH_INFO: `/v3/projects/3d5345c52c1149eab158536779214dfe` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:13.256657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5345c52c1149eab158536779214dfe)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:13.256657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:13.371675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5345c52c1149eab158536779214dfe', 'request_id': 'req-1f714615-189a-441f-b9f2-5d5ebac28ca3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.377024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5345c52c1149eab158536779214dfe', 'request_id': 'req-1f714615-189a-441f-b9f2-5d5ebac28ca3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.450835 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5345c52c1149eab158536779214dfe', 'request_id': 'req-1f714615-189a-441f-b9f2-5d5ebac28ca3'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.463130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] The token cache is being invalidate because project 3d5345c52c1149eab158536779214dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:13.463420 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.464055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.465574 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1395/2826] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:13 2022] DELETE /identity/v3/projects/3d5345c52c1149eab158536779214dfe => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:13.469925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:13.479608 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71cd5-3189-457d-9c6e-1c73f77c1d96 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:13.538166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:13.538786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:13.539059 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:13.539328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] PATH_INFO: `/v3/users/faa620824582454f98e4a0b569f80971` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:13.540442 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa620824582454f98e4a0b569f80971)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:13.542435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:13.543886 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:13.774584 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa620824582454f98e4a0b569f80971'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.775234 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa620824582454f98e4a0b569f80971'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.782214 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa620824582454f98e4a0b569f80971'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.794828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa620824582454f98e4a0b569f80971'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.795495 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-461a7b54-e8f1-4ffe-ae62-0c90f6c65f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa620824582454f98e4a0b569f80971'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:13.879794 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1432/2827] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:13 2022] DELETE /identity/v3/users/faa620824582454f98e4a0b569f80971 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:14.321708 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:14.323168 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:14.338559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714615-189a-441f-b9f2-5d5ebac28ca3 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:14.396623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:14.397253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.397529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.397800 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] PATH_INFO: `/v3/projects/9c27777238e140ac9d03e1f6c134e421` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.398904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c27777238e140ac9d03e1f6c134e421)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:14.400816 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:14.518989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c27777238e140ac9d03e1f6c134e421', 'request_id': 'req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:14.524389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c27777238e140ac9d03e1f6c134e421', 'request_id': 'req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:14.527904 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:14.605558 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c27777238e140ac9d03e1f6c134e421', 'request_id': 'req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:14.617309 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] The token cache is being invalidate because project 9c27777238e140ac9d03e1f6c134e421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:14.617625 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:14.618265 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b4cd5c37-17ac-43d9-bdb5-cc1844f02a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:14.619744 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1396/2828] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:14 2022] DELETE /identity/v3/projects/9c27777238e140ac9d03e1f6c134e421 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:14.624787 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.625261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.625369 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.645586 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:14.646798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:14.704554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1433/2829] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 11:06:14.712130 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.712421 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.712967 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.734525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:14.735737 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:14.744526 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1397/2830] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:14.750843 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:14.761605 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02f0f5-0f93-46c7-9387-5e1f762895df None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:14.766367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:14.767017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.767304 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.767575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.768227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:06:14.768531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:14.770371 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:14.782047 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1434/2831] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:06:14.787070 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:14.796434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1a5a9-df94-42e2-a0f1-b9e3296de159 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:14.801691 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:14.802276 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.802550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.802814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.803448 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:14.805355 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:14.903480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1398/2832] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:14 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:06:14.907828 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:14.918552 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faa9bf-74c4-48a6-8308-1b08c26e06f4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:14.975360 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:14.976082 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:14.976367 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:14.976671 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:14.977314 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:14.979233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:14.990186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:15.074307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1435/2833] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:14 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:15.078546 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.089724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d9d6-6c26-4385-b2ad-986f5eedc48f admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.094576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.095167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.095439 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.095705 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.096395 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.098370 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.108147 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1399/2834] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:15.112057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.122001 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6f70b-7bdf-4f65-9170-9a86bd927c86 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.126675 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.127260 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.127534 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.127806 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.128999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.130585 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f2bc-7143-4f63-8afb-06f3c48aa12d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.140877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1436/2835] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:15.145827 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.155780 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb7f45-38be-45a8-8ff7-73c264e6aa6e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.160359 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.161024 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.161340 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.161609 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] PATH_INFO: `/v3/projects/b5564946f03945a1ad1a7cab9d8a771c/users/2ed19a7186a24e31a0e4f8dbb3a6d1a8/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.176475 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5564946f03945a1ad1a7cab9d8a771c, user_id=2ed19a7186a24e31a0e4f8dbb3a6d1a8, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.179125 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.267652 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1400/2836] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:15 2022] PUT /identity/v3/projects/b5564946f03945a1ad1a7cab9d8a771c/users/2ed19a7186a24e31a0e4f8dbb3a6d1a8/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:06:15.277792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.278081 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.278355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.306906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] MFA Rules not processed for user `2ed19a7186a24e31a0e4f8dbb3a6d1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:15.308113 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:15.373331 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1437/2837] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:15.377730 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.438848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d9e-c09b-47cd-9a1b-61fec4587111 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.444062 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.444686 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.444964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.445230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.445847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.447711 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.612274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1401/2838] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:15 2022] POST /identity/v3/projects => generated 399 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:15.617189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.627687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc29cc-cc2b-477f-8ad2-777f20b7ca83 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.683225 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.683819 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.684096 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.684386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.685031 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.686950 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.799716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1438/2839] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:15 2022] POST /identity/v3/users => generated 306 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 11:06:15.804545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.814923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9506-9a06-4886-8674-9b41e6fa5b53 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.819654 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.820247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.820529 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.820839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.821481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.823064 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.833834 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1402/2840] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:15.838041 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.849187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f54f1-82f4-4164-a790-c9aa3d4fc525 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:15.854465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:15.855157 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:15.855485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:15.855754 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] PATH_INFO: `/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f/users/4c2c148b2e684715a88c208140a0c300/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:15.871058 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3c6c5b51b94c04aeb4a4171112f46f, user_id=4c2c148b2e684715a88c208140a0c300, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:15.873766 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:15.971847 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1439/2841] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:15 2022] PUT /identity/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f/users/4c2c148b2e684715a88c208140a0c300/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:15.977774 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:15.988114 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a046c3f-26be-435b-9cbd-cb5fc2a5897b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:16.044530 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:16.045164 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:16.045446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:16.045722 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:16.046362 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:16.047948 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdf081-953f-4e7a-8437-0fe83c4b55ac admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:16.050099 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:16.058175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1403/2842] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:16.062392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:16.073255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336d91-c11e-4f96-913a-14f243016fb9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:16.077896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:16.078579 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:16.078863 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:16.079139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] PATH_INFO: `/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f/users/4c2c148b2e684715a88c208140a0c300/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:16.081643 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3c6c5b51b94c04aeb4a4171112f46f, user_id=4c2c148b2e684715a88c208140a0c300, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:16.084348 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:16.094920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1440/2843] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:16 2022] PUT /identity/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f/users/4c2c148b2e684715a88c208140a0c300/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:16.105627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:16.105914 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:16.106189 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:16.133564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] MFA Rules not processed for user `4c2c148b2e684715a88c208140a0c300`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:16.134772 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:16.202194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1404/2844] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:16.389624 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:16.391276 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:16.421728 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:16.448461 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8fe89-dc42-4339-8870-1b8f85a3d885 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:16.452668 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:16.453266 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:16.453543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:16.453812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:16.463321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:16.464789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:16.474536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1441/2845] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:16.695126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:16.705173 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0935193-d920-4f9c-b2a4-44e09816daf3 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:16.708947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:16.709554 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:16.709833 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:16.710103 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:16.766580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:16.768008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b31adc-9756-4dc9-a62d-6d6e94ff176b service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:16.777576 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1405/2846] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:21.991488 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:22.053388 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561162a-6ff4-410f-8993-6546e23470df service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:22.058079 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:22.058729 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:22.059005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:22.059277 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] PATH_INFO: `/v3/users/2ed19a7186a24e31a0e4f8dbb3a6d1a8` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:22.060376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed19a7186a24e31a0e4f8dbb3a6d1a8)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:22.062327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:22.242162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed19a7186a24e31a0e4f8dbb3a6d1a8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:22.242774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed19a7186a24e31a0e4f8dbb3a6d1a8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:22.249628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed19a7186a24e31a0e4f8dbb3a6d1a8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:22.262531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed19a7186a24e31a0e4f8dbb3a6d1a8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:22.263189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed19a7186a24e31a0e4f8dbb3a6d1a8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:22.342057 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1442/2847] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:21 2022] DELETE /identity/v3/users/2ed19a7186a24e31a0e4f8dbb3a6d1a8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:22.347944 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:22.348547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:22.348547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:22.368812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:22.370067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:22.427287 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1406/2848] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:22.437029 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:22.438435 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:22.491236 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:22.495210 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c1483-37da-4cca-8c1a-c73351fd83fa admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:22.498759 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:22.499355 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:22.499632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:22.499900 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:22.508719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:22.510588 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:22.519318 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1443/2849] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:22.944335 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:22.945876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:22.965052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad2263-1b8f-41d6-901b-32fd762a3e1c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:22.970470 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:22.970985 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:22.971321 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:22.972296 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] PATH_INFO: `/v3/projects/b5564946f03945a1ad1a7cab9d8a771c` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:22.973945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5564946f03945a1ad1a7cab9d8a771c)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:22.976999 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:22.995408 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:23.085264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5564946f03945a1ad1a7cab9d8a771c', 'request_id': 'req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.090477 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5564946f03945a1ad1a7cab9d8a771c', 'request_id': 'req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.193767 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5564946f03945a1ad1a7cab9d8a771c', 'request_id': 'req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.210423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] The token cache is being invalidate because project b5564946f03945a1ad1a7cab9d8a771c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:23.210714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.211360 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.212865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1407/2850] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:22 2022] DELETE /identity/v3/projects/b5564946f03945a1ad1a7cab9d8a771c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:23.217012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:23.227186 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef22a0-3318-413e-8130-875c1e656de0 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:23.283756 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:23.284620 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:23.284910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:23.285182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] PATH_INFO: `/v3/users/4c2c148b2e684715a88c208140a0c300` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:23.286292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2c148b2e684715a88c208140a0c300)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:23.288206 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:23.526746 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2c148b2e684715a88c208140a0c300'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.527392 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2c148b2e684715a88c208140a0c300'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.534182 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2c148b2e684715a88c208140a0c300'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.545931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2c148b2e684715a88c208140a0c300'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.546594 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-d1cebcad-5f0e-47f4-8121-36ac08145c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2c148b2e684715a88c208140a0c300'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:23.639198 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1444/2851] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:23 2022] DELETE /identity/v3/users/4c2c148b2e684715a88c208140a0c300 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:24.115253 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.116757 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:24.130111 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee07e5-5a53-42ff-abbf-fe1ae6e7ab32 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.188663 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.189293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.189560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.189829 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] PATH_INFO: `/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.190952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3c6c5b51b94c04aeb4a4171112f46f)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.192872 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.319011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3c6c5b51b94c04aeb4a4171112f46f', 'request_id': 'req-b7c620ea-c255-4a11-b487-26d8857710f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:24.324441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3c6c5b51b94c04aeb4a4171112f46f', 'request_id': 'req-b7c620ea-c255-4a11-b487-26d8857710f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:24.394325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3c6c5b51b94c04aeb4a4171112f46f', 'request_id': 'req-b7c620ea-c255-4a11-b487-26d8857710f1'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:24.405550 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] The token cache is being invalidate because project cb3c6c5b51b94c04aeb4a4171112f46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:24.405857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:24.406481 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-b7c620ea-c255-4a11-b487-26d8857710f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:24.407935 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1408/2852] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:24 2022] DELETE /identity/v3/projects/cb3c6c5b51b94c04aeb4a4171112f46f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:24.413018 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.413545 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.413660 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.433720 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:24.435065 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:24.493443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1445/2853] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:24.501303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.501588 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.501861 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.521825 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:24.523022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:24.530814 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1409/2854] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:24.535734 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.545306 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6311d7a-c69a-4689-b5f7-8b865f4612e6 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.550627 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.551227 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.551504 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.551775 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.552418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:06:24.552760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.554358 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.560934 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:24.565883 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1446/2855] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:06:24.570211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.579431 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e94a-e9d7-45d6-b55a-6b97342a74ea None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.584427 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.585055 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.585353 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.585623 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.586294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.588195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.698183 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1410/2856] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:24 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:24.702429 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.712692 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5182-3331-4b9b-82e7-c70b1699a78a admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.769598 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.770217 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.770491 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.770760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.771376 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.773316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.897278 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1447/2857] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:24 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:24.901571 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.912469 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da3210-06e3-41b1-b3aa-205feacff399 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.917023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.917714 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.917978 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.918249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.918961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.920552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.921802 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:24.931545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1411/2858] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:24.935516 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.945888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31488-85b4-48f5-97df-765ca5faf90e admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.950703 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.951221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.951507 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.951858 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:24.952510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:24.954224 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4126b6-0837-44b4-83c9-9c321ca4ca9b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:24.965809 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1448/2859] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:24.970547 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:24.981830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a25ad-cfdf-4afd-b43d-5417bc57b026 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:24.986423 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:24.987167 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:24.987942 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:24.988434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] PATH_INFO: `/v3/projects/509f7125061043278acef9bee034b817/users/0f532774e78c402c97d4fe2da83295cd/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.003377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=509f7125061043278acef9bee034b817, user_id=0f532774e78c402c97d4fe2da83295cd, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.006018 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.090746 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1412/2860] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:24 2022] PUT /identity/v3/projects/509f7125061043278acef9bee034b817/users/0f532774e78c402c97d4fe2da83295cd/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:25.103212 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20474-143c-45d1-a516-466da95d8067 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.103501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20474-143c-45d1-a516-466da95d8067 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.103774 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20474-143c-45d1-a516-466da95d8067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.132410 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-45a20474-143c-45d1-a516-466da95d8067 None None] MFA Rules not processed for user `0f532774e78c402c97d4fe2da83295cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:25.133647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-45a20474-143c-45d1-a516-466da95d8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:25.197792 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1449/2861] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:25.202500 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.265281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95aec2-d087-4d93-b2f6-ca31ee0aa6db admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.270923 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.271618 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.271922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.272195 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.273026 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.274928 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.403545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1413/2862] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:25 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:25.407836 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20474-143c-45d1-a516-466da95d8067 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.418704 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20474-143c-45d1-a516-466da95d8067 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.475211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.475741 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.476019 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.476316 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.476979 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.478897 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.489829 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:25.622289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1450/2863] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:25 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:25.626419 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.637199 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18866c-cb05-4f27-bf5f-4e152443d55d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.641847 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.642437 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.642710 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.642982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.644267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.645896 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.656480 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1414/2864] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 11:06:25.660485 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.670626 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7df5d-dc95-46d5-9402-6b085de0a2b9 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.676000 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.676611 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.676896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.677168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.677804 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.679405 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440ef5a-c823-43d2-bcd9-b272ba10f3ee admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.689180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1451/2865] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:25.693683 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.703426 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654210f-047d-4f01-b7e9-e7da5d5ca8f8 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.708156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.708831 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.709106 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.709377 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] PATH_INFO: `/v3/projects/a9775f55838949f88d9f839de81c6e4a/users/bc5fb9d3f6fb46c9b5985f3eef9f2151/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.723969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9775f55838949f88d9f839de81c6e4a, user_id=bc5fb9d3f6fb46c9b5985f3eef9f2151, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.726670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:25.817188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1415/2866] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:25 2022] PUT /identity/v3/projects/a9775f55838949f88d9f839de81c6e4a/users/bc5fb9d3f6fb46c9b5985f3eef9f2151/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:25.827334 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.827617 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.827888 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.856908 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] MFA Rules not processed for user `bc5fb9d3f6fb46c9b5985f3eef9f2151`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:25.858167 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:25.922213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1452/2867] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:25.927433 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:25.990952 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56158e14-6ed2-4b34-959d-5e19de3ab9ff admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:25.995473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:25.996161 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:25.996434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:25.996733 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:25.997367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:25.999241 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.103402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1416/2868] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:25 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:26.107428 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.118465 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eaef7-6f1b-4fd3-a60a-5eeea6ed352f None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.174123 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.174918 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.175327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.175604 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.176256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.178248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.307952 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1453/2869] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:26 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:26.311907 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.322871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a760-4c5d-4afd-a510-cebeb7192b73 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.327534 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.328127 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.328406 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.328717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.329356 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.331593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.332846 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:26.342747 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1417/2870] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:26.346912 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.357993 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289ddc6-a765-4537-83f1-b78d466188e7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.362571 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.363335 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.363613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.363885 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] PATH_INFO: `/v3/projects/0b2df66e94eb43eca672ba41200af14d/users/11f302d75f66415c904b2343574f923d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.379120 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2df66e94eb43eca672ba41200af14d, user_id=11f302d75f66415c904b2343574f923d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.381965 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.451094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1454/2871] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:26 2022] PUT /identity/v3/projects/0b2df66e94eb43eca672ba41200af14d/users/11f302d75f66415c904b2343574f923d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:26.455115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.465487 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941715ff-c17c-465f-ad1d-c089ff4a9c3c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.521724 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.522320 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.522595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.522863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.523486 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.525100 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc1a5-44ad-44ba-96fb-1425deb3a051 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.534586 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1418/2872] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:26.538839 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.549061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e279-a3fa-4bc2-b63e-7ad930f31cba admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.554760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.555411 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.555687 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.555956 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] PATH_INFO: `/v3/projects/0b2df66e94eb43eca672ba41200af14d/users/11f302d75f66415c904b2343574f923d/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.557928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2df66e94eb43eca672ba41200af14d, user_id=11f302d75f66415c904b2343574f923d, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.560709 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.571701 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1455/2873] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:26 2022] PUT /identity/v3/projects/0b2df66e94eb43eca672ba41200af14d/users/11f302d75f66415c904b2343574f923d/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:26.581857 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.582143 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.582415 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.610382 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] MFA Rules not processed for user `11f302d75f66415c904b2343574f923d`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:26.611580 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:26.678293 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1419/2874] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:26.689536 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:26.691901 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:26.723189 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:26.748807 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff3c42-42cb-41d0-b05d-29b8e9ae0123 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:26.754895 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:26.755503 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:26.755786 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:26.756087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:26.812087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:26.813466 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:26.822321 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1456/2875] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:28.949890 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:28.951304 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:28.964188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b8bb2-1f35-4896-becf-892126c87544 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:28.967955 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:28.968551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:28.968852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:28.969121 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:29.024108 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:29.025552 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:29.034794 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1420/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:30.737126 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:30.745543 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd71eb-ccdb-4ebf-bdc1-bd3fa7aabc35 service cinder] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:30.749248 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7dce5cc34ce4930ade1d9ba9e3bddd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:30.749840 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:30.750114 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:30.750379 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:30.760652 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:30.762074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655b4c-f6c0-4144-aa1f-062ec8cc350f service cinder] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:30.772257 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1457/2877] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:35.553350 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:35.570381 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=100 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:35.616023 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4779d-d095-49ca-890b-fb721f9417bb service cinder] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:35.620557 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:35.621211 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:35.621488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:35.621754 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] PATH_INFO: `/v3/users/0f532774e78c402c97d4fe2da83295cd` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:35.622867 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f532774e78c402c97d4fe2da83295cd)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:35.624812 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:35.863681 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f532774e78c402c97d4fe2da83295cd'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:35.864338 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f532774e78c402c97d4fe2da83295cd'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:35.872277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f532774e78c402c97d4fe2da83295cd'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:35.873105 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f532774e78c402c97d4fe2da83295cd'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:35.886008 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f532774e78c402c97d4fe2da83295cd'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.006115 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1421/2878] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:35 2022] DELETE /identity/v3/users/0f532774e78c402c97d4fe2da83295cd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:36.010490 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:36.010959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:36.011073 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:36.031837 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:36.033106 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:36.091256 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1458/2879] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:36.101521 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:36.102961 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:36.161176 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22cbe2-cbb5-464b-b07d-31634d717f30 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:36.164980 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:36.165573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:36.165849 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:36.166165 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:36.175549 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:36.177005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:36.186671 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1422/2880] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:36.659056 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:36.660722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:36.672928 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71d9b3-5cbc-4f55-844a-6dde397dc2c0 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:36.678670 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:36.679307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:36.679581 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:36.679860 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] PATH_INFO: `/v3/projects/509f7125061043278acef9bee034b817` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:36.680980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509f7125061043278acef9bee034b817)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:36.682902 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:36.817164 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509f7125061043278acef9bee034b817', 'request_id': 'req-3edee559-1da3-4b0e-84c2-5830910491d8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.822512 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509f7125061043278acef9bee034b817', 'request_id': 'req-3edee559-1da3-4b0e-84c2-5830910491d8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.826110 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:36.959735 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509f7125061043278acef9bee034b817', 'request_id': 'req-3edee559-1da3-4b0e-84c2-5830910491d8'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.972134 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] The token cache is being invalidate because project 509f7125061043278acef9bee034b817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:36.972424 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.973083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:36.974647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1459/2881] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:36 2022] DELETE /identity/v3/projects/509f7125061043278acef9bee034b817 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:36.978598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:36.989657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0ba1-8dde-4af3-9340-6f1c849a7410 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:37.023880 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:37.046638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:37.047264 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:37.047545 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:37.047820 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] PATH_INFO: `/v3/users/bc5fb9d3f6fb46c9b5985f3eef9f2151` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:37.048975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5fb9d3f6fb46c9b5985f3eef9f2151)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:37.051888 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:37.383651 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5fb9d3f6fb46c9b5985f3eef9f2151'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:37.384317 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5fb9d3f6fb46c9b5985f3eef9f2151'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:37.391472 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5fb9d3f6fb46c9b5985f3eef9f2151'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:37.392154 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5fb9d3f6fb46c9b5985f3eef9f2151'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:37.404638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5fb9d3f6fb46c9b5985f3eef9f2151'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:37.484525 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1423/2882] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:36 2022] DELETE /identity/v3/users/bc5fb9d3f6fb46c9b5985f3eef9f2151 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:37.910381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:37.911814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:37.925932 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edee559-1da3-4b0e-84c2-5830910491d8 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:37.988471 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:37.989137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:37.989419 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:37.989719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] PATH_INFO: `/v3/projects/a9775f55838949f88d9f839de81c6e4a` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:37.990844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9775f55838949f88d9f839de81c6e4a)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:37.992814 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:38.107799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9775f55838949f88d9f839de81c6e4a', 'request_id': 'req-77da67c1-1256-4b33-ade2-4e7335f8dabd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.113555 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9775f55838949f88d9f839de81c6e4a', 'request_id': 'req-77da67c1-1256-4b33-ade2-4e7335f8dabd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.182401 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9775f55838949f88d9f839de81c6e4a', 'request_id': 'req-77da67c1-1256-4b33-ade2-4e7335f8dabd'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.194986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] The token cache is being invalidate because project a9775f55838949f88d9f839de81c6e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:38.195272 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.195907 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.197460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1460/2883] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:37 2022] DELETE /identity/v3/projects/a9775f55838949f88d9f839de81c6e4a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:06:38.201467 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:38.202866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:38.215752 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de0c1-802e-48ee-bff8-734417e0f97d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:38.272277 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:38.272943 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:38.273222 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:38.273498 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] PATH_INFO: `/v3/users/11f302d75f66415c904b2343574f923d` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:38.274617 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f302d75f66415c904b2343574f923d)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:38.276527 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:38.534542 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f302d75f66415c904b2343574f923d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.535365 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f302d75f66415c904b2343574f923d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.542118 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f302d75f66415c904b2343574f923d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.544581 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f302d75f66415c904b2343574f923d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.545389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:38.556274 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3d7ada53-2fbc-48f0-9b8a-8cf282e71750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f302d75f66415c904b2343574f923d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:38.662316 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1424/2884] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:06:38 2022] DELETE /identity/v3/users/11f302d75f66415c904b2343574f923d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:39.134777 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.136982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:39.150882 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da67c1-1256-4b33-ade2-4e7335f8dabd admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:39.207460 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:39.208087 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.208363 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.208661 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] PATH_INFO: `/v3/projects/0b2df66e94eb43eca672ba41200af14d` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.209767 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2df66e94eb43eca672ba41200af14d)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:39.211667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:39.235796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:39.375483 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2df66e94eb43eca672ba41200af14d', 'request_id': 'req-0ca5aed0-ede3-4eee-9606-f4539d5ded04'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:39.381510 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2df66e94eb43eca672ba41200af14d', 'request_id': 'req-0ca5aed0-ede3-4eee-9606-f4539d5ded04'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:39.473935 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2df66e94eb43eca672ba41200af14d', 'request_id': 'req-0ca5aed0-ede3-4eee-9606-f4539d5ded04'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:39.485589 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] The token cache is being invalidate because project 0b2df66e94eb43eca672ba41200af14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:06:39.487090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:39.487090 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-0ca5aed0-ede3-4eee-9606-f4539d5ded04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:06:39.488705 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1461/2885] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:06:39 2022] DELETE /identity/v3/projects/0b2df66e94eb43eca672ba41200af14d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:39.493593 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.494098 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.494212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.514845 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:39.516049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:39.573235 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1425/2886] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:39.581554 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.581961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.582327 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.603027 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:39.604200 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:39.612722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1462/2887] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:39.617140 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.627037 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e72390-a6dd-42d5-81be-df514509116c None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:39.631689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:39.632281 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.632560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.632868 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] PATH_INFO: `/v3/domains` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.633514 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:06:39.633813 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:39.635409 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:39.646947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1426/2888] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 11:06:39.651127 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.660841 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd066-67b1-4bc3-9849-251c0b9290ff None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:39.666406 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:39.667221 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.667528 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.667799 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.668455 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:39.670443 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:39.784403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1463/2889] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:06:39 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:39.788638 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.798817 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9686114-0234-4d01-a8be-627f2bbfd57b admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:39.859052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:39.859685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.859968 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.860243 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] PATH_INFO: `/v3/users` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.860930 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:39.863602 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:39.947175 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1427/2890] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:06:39 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:06:39.951699 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.962923 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be9920-07b9-470d-aaac-d3375cbf19c4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:39.967782 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:39.968374 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:39.968713 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:39.968981 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:39.969615 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:39.971891 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:39.981846 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1464/2891] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:39.986020 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:39.996133 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cfff-fa46-4acd-ac99-21a4acac4784 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:40.000804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:40.001397 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:40.001674 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:40.001945 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:40.002584 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:40.004192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a942c-3fb9-47cf-a1e6-5d77cc5f5515 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:40.014793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1428/2892] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:06:40.019323 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:40.029166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afc46a-f3f6-4d44-be18-da13e96d9250 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:40.034382 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:40.035017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:40.035288 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:40.035556 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] PATH_INFO: `/v3/projects/58c992930d294c4a95ea4e84b266a6d4/users/0788c51fe0ab41a0846471b6ca3689c9/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:40.049740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c992930d294c4a95ea4e84b266a6d4, user_id=0788c51fe0ab41a0846471b6ca3689c9, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:40.052361 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:40.141876 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1465/2893] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:06:40 2022] PUT /identity/v3/projects/58c992930d294c4a95ea4e84b266a6d4/users/0788c51fe0ab41a0846471b6ca3689c9/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:06:40.152982 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:40.153271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:40.153566 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:40.181771 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] MFA Rules not processed for user `0788c51fe0ab41a0846471b6ca3689c9`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:06:40.182984 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:40.212488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:40.245502 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1429/2894] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:06:40.257238 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:40.258896 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:40.337711 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b263b-2b49-4b1a-a603-ac85746c565c admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:40.341368 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0c38e0197d54850803f0cf9a3419dbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:40.341959 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:40.342233 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:40.342765 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:40.350877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:40.352293 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:40.360931 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1466/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:06:50.318836 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=13 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:50.356953 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=77,keystone:DELETE=6,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:06:52.021712 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:06:52.023137 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:52.091598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248f2f6-3a05-40a2-926b-bfd07a474047 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:06:52.097378 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:06:52.097981 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:06:52.098262 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:06:52.098556 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:06:52.100230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:06:52.111656 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:06:52.113283 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd1845-ab21-4a68-9dac-cce5fbfac76e service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:06:52.123191 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1430/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:06:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:07:02.118852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=32 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:13.979716 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:14.042347 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8a54-6d1e-43cb-afbe-68f609b973e3 service glance] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:14.046812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:14.047440 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:14.048547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:14.048547 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] PATH_INFO: `/v3/users/0788c51fe0ab41a0846471b6ca3689c9` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:14.049637 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0788c51fe0ab41a0846471b6ca3689c9)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:14.051559 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:14.275450 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0788c51fe0ab41a0846471b6ca3689c9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:14.276089 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0788c51fe0ab41a0846471b6ca3689c9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:14.283521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0788c51fe0ab41a0846471b6ca3689c9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:14.299723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0788c51fe0ab41a0846471b6ca3689c9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:14.299723 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0788c51fe0ab41a0846471b6ca3689c9'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:14.403880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1467/2897] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:07:13 2022] DELETE /identity/v3/users/0788c51fe0ab41a0846471b6ca3689c9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:07:14.408975 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:14.409443 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:14.409559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:14.428983 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:14.431793 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:14.488271 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1431/2898] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:14.497849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:14.499245 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:14.557769 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cb903-0842-453e-967c-eaa598eafd19 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:14.561357 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:14.561961 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:14.562255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:14.562524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:14.571520 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:14.572989 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632477f-518b-4dd8-8643-ada167a1a5cf service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:14.582880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1468/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:07:15.028964 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.030424 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:15.042675 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f30dd8-f167-44c6-ad3f-0006ea77dd81 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.047449 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.048260 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.048670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.048947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] PATH_INFO: `/v3/projects/58c992930d294c4a95ea4e84b266a6d4` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.050097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c992930d294c4a95ea4e84b266a6d4)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.052007 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.175126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c992930d294c4a95ea4e84b266a6d4', 'request_id': 'req-3ea862ba-3dcf-4235-8b90-51dbb658f98b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:15.180605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c992930d294c4a95ea4e84b266a6d4', 'request_id': 'req-3ea862ba-3dcf-4235-8b90-51dbb658f98b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:15.284598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c992930d294c4a95ea4e84b266a6d4', 'request_id': 'req-3ea862ba-3dcf-4235-8b90-51dbb658f98b'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:15.299251 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] The token cache is being invalidate because project 58c992930d294c4a95ea4e84b266a6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:07:15.299539 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:15.300228 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-3ea862ba-3dcf-4235-8b90-51dbb658f98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:07:15.301786 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1432/2900] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:07:15 2022] DELETE /identity/v3/projects/58c992930d294c4a95ea4e84b266a6d4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:07:15.306681 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.307166 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.307273 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.327575 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:15.328982 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:15.345877 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:15.388017 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1469/2901] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:15.397605 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.397886 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.398162 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.418453 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:15.421741 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:15.428163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1433/2902] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:15.432573 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.444156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cccab7-4372-4f79-b6c4-55b664ba0585 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.448808 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.449403 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.449810 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.450085 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] PATH_INFO: `/v3/domains` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.450844 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 11:07:15.451147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.452789 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.464695 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1470/2903] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 5 11:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 11:07:15.469193 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.478561 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ee6a3-617a-40de-97bf-237277b28a56 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.483249 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.483839 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.484116 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.484388 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.485559 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.487434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.599969 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1434/2904] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:07:15 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:07:15.604098 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.614768 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06599495-b904-42b6-9aa1-0d469fba9401 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.669753 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.670350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.670628 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.670899 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.671521 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.674070 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.747095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1471/2905] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:07:15 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:07:15.751496 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.761972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2496-7f35-40dd-ac24-2a5bab34013d admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.767005 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.767685 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.767989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.768261 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.768989 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.770595 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.780871 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1435/2906] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:07:15.785220 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.795452 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e2448-2ae1-4ba7-b9a0-02522c2c2ea4 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.800938 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.801523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.801798 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.802147 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.802779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.804415 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1d33-df3c-4823-837b-d05c5c140a3f admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.815105 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1472/2907] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:07:15.819052 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:15.829214 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a577-fcd5-49ea-a7ef-08a97718f0cd admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:15.833807 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:15.834445 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.834721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.834995 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] PATH_INFO: `/v3/projects/c5366550c35e45c48938b8afcabef8cd/users/f70cf334f4ea4c97be52af0e5047bb0b/roles/47fd5bc6d0614f6390457e9815727925` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.853402 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5366550c35e45c48938b8afcabef8cd, user_id=f70cf334f4ea4c97be52af0e5047bb0b, role_id=47fd5bc6d0614f6390457e9815727925)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:15.853598 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:15.964689 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1436/2908] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:07:15 2022] PUT /identity/v3/projects/c5366550c35e45c48938b8afcabef8cd/users/f70cf334f4ea4c97be52af0e5047bb0b/roles/47fd5bc6d0614f6390457e9815727925 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 11:07:15.970109 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dffb6e-4f3a-41cc-9c41-1a0e78bcac73 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:15.970393 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dffb6e-4f3a-41cc-9c41-1a0e78bcac73 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:15.970665 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dffb6e-4f3a-41cc-9c41-1a0e78bcac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:15.989439 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-90dffb6e-4f3a-41cc-9c41-1a0e78bcac73 None None] MFA Rules not processed for user `bcff4f18a9994f58badcd6e80f8b0bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:15.990657 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-90dffb6e-4f3a-41cc-9c41-1a0e78bcac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:16.049682 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1473/2909] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:16.059156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:16.060866 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:16.083367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:16.121255 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4945-5ecb-4329-bef4-0960dd37d5ba admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:16.125126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:16.126002 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:16.126509 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:16.126790 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:16.136777 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:16.138197 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:16.148635 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1437/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:07:21.732255 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:21.732796 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:21.732920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:21.763464 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] MFA Rules not processed for user `f70cf334f4ea4c97be52af0e5047bb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:21.764719 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:21.804083 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:21.841074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1474/2911] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:21.846270 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:21.856627 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70844-570b-4f54-9f86-8d8854994dfe service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:21.862188 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:21.862792 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:21.863083 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:21.863337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:21.863972 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:21.865887 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.082891 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1438/2912] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 5 11:07:21 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:07:22.084074 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:22.095672 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f51a1-e49e-4e47-801b-1b928f5ef436 None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:22.150780 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:22.151386 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:22.151667 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:22.151964 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] PATH_INFO: `/v3/users` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:22.152574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:22.154524 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.273565 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1475/2913] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 5 11:07:22 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 11:07:22.277560 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:22.288011 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37860-f993-4620-ad84-eb7f893dcb42 admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:22.292538 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:22.293158 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:22.293434 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:22.293699 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:22.294328 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:22.295939 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.307949 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1439/2914] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:07:22.312179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:22.322988 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d38a-843c-4478-89c4-ae4a8bcdf49b admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:22.328226 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:22.328906 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:22.329154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:22.329426 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] PATH_INFO: `/v3/projects/5090fa311c864e1fbb808773b68a1e96/users/614a5a8d5ed64af086dc2b87a73c4676/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:22.344179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090fa311c864e1fbb808773b68a1e96, user_id=614a5a8d5ed64af086dc2b87a73c4676, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:22.346980 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.451097 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1476/2915] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:07:22 2022] PUT /identity/v3/projects/5090fa311c864e1fbb808773b68a1e96/users/614a5a8d5ed64af086dc2b87a73c4676/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:07:22.457721 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:22.468337 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56463-3bbf-4b82-b0ee-9c83cd760c8e admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:22.526612 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:22.527230 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:22.527505 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:22.527773 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:22.528414 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:22.530051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5011d-1623-47b3-999b-7a299856fc90 admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.541028 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1440/2916] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 5 11:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 11:07:22.545258 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:22.556297 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44559b-e997-4fe4-91af-3d934f25ba31 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:22.560925 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:22.561572 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:22.561850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:22.562121 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] PATH_INFO: `/v3/projects/5090fa311c864e1fbb808773b68a1e96/users/614a5a8d5ed64af086dc2b87a73c4676/roles/48e3bab9028e4370a46d727b6f58ef26` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:22.564416 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090fa311c864e1fbb808773b68a1e96, user_id=614a5a8d5ed64af086dc2b87a73c4676, role_id=48e3bab9028e4370a46d727b6f58ef26)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:22.567095 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:22.578100 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1477/2917] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 5 11:07:22 2022] PUT /identity/v3/projects/5090fa311c864e1fbb808773b68a1e96/users/614a5a8d5ed64af086dc2b87a73c4676/roles/48e3bab9028e4370a46d727b6f58ef26 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:07:28.289668 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d024-c47b-47e5-b9a8-b0ae21462b4b None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:28.290192 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d024-c47b-47e5-b9a8-b0ae21462b4b None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:28.290319 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d024-c47b-47e5-b9a8-b0ae21462b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:28.321690 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-3558d024-c47b-47e5-b9a8-b0ae21462b4b None None] MFA Rules not processed for user `614a5a8d5ed64af086dc2b87a73c4676`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:28.322994 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-3558d024-c47b-47e5-b9a8-b0ae21462b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:28.399482 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1441/2918] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:28.422387 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:28.423986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:28.522943 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9d517-c000-45b5-8f53-af93127cdaf7 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:28.530054 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:28.530632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:28.530978 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:28.531322 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:28.538833 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:28.592162 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:28.595168 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:28.603997 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1478/2919] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:07:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:07:38.396564 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:38.775646 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=24 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:45.913756 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:45.915325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:45.915325 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:45.933670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] MFA Rules not processed for user `f70cf334f4ea4c97be52af0e5047bb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:07:45.934863 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:45.942067 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1442/2920] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:07:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:07:46.272531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:07:46.273949 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:46.329570 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b1429-f7b3-4641-9bd2-12fc9fe7b8ee service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:07:46.333080 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:07:46.333684 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:07:46.333947 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:07:46.334211 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:07:46.335887 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:07:46.345354 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:07:46.346779 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:07:46.354613 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1479/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:07:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:07:55.928213 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=3 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:07:56.351179 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=26 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:08:03.160149 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:08:03.165212 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:08:03.177551 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c6c0a-c21e-48ec-bc3f-c6b396689c09 None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:08:03.182876 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:08:03.183473 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:08:03.183748 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:08:03.184019 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:08:03.185702 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:08:03.197728 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:08:03.199543 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:08:03.210396 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1443/2922] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:08:06.264009 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:08:06.273328 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d844fb-b830-49d7-b634-5cfe99a4561c service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:08:06.276983 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:08:06.277577 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:08:06.277853 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:08:06.278122 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:08:06.287740 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:08:06.289209 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:08:06.298647 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1480/2923] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:08:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:08:13.206022 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=6 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:08:16.294501 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=6 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:09:59.731856 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:09:59.741312 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c773ef-b36d-4426-b035-1110e1df33c1 service nova] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:09:59.746247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:09:59.746247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:09:59.746247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:09:59.746247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:09:59.747908 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:09:59.758129 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:09:59.759537 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:09:59.767926 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1444/2924] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:09:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:03.404156 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:03.413247 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b0d7-f799-4552-8fed-f3d3c74375e5 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:03.417184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:03.417812 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:03.418088 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:03.418353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:03.420118 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:03.435311 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:03.436757 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:03.448730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1481/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:04.638054 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:04.646787 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb327d-3d27-4a32-a3a2-24cd25582939 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:04.650379 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:04.651622 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:04.651893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:04.652163 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:04.653893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:04.667294 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:04.668743 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230cdb6-d205-48e9-bea1-aba21cfec45c service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:04.679788 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1445/2926] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:05.755632 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:05.769194 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae2fb-4ba0-4697-a118-028421a5d722 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:05.775112 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:05.776092 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:05.778790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:05.778790 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:05.779139 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:05.793484 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:05.795077 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:05.809678 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1482/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:08.104410 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] REQUEST_METHOD: `POST` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:08.104925 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:08.105039 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:08.124152 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.auth.core [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] MFA Rules not processed for user `f70cf334f4ea4c97be52af0e5047bb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:10:08.125367 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:08.132069 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1446/2928] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:10:08.446300 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:08.456289 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c393a82-f19c-42fb-a75f-919af6633168 service nova] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:08.460243 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:08.461075 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:08.461350 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:08.461619 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:08.464366 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:08.475115 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:08.476531 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:08.485213 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1483/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:09.218555 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:09.220358 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:09.295640 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b648b2-74f8-4557-88a6-6b8b557909bf None None] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:09.300528 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:09.301156 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:09.301432 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:09.301717 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:09.303504 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:09.315336 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:09.316933 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:09.326725 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1447/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:18.480986 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=18 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:10:19.322488 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=47 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:10:27.913523 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:10:27.927502 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23deae6f-24f3-4b8d-b7cc-bc4344b831bb service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:10:27.933187 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a69da51c538a4e29ac81a774c36c4931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:10:27.933817 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:10:27.934094 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:10:27.934574 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:10:27.936511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:10:27.958040 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:10:27.959874 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d8692-a7aa-4db4-97dd-3229f63dd9d4 service nova] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:10:27.973909 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1484/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:10:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:10:37.968544 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=6 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:11:59.126203 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:11:59.127613 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:11:59.213122 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3adf-9bcf-4479-9f67-bc878ccfa911 service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:11:59.218267 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:11:59.218860 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:11:59.219139 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:11:59.219405 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:11:59.221398 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:11:59.233126 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:11:59.236804 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:11:59.244848 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1448/2932] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:12:02.867926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] REQUEST_METHOD: `POST` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:12:02.868437 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:12:02.868550 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:12:02.888353 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.auth.core [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] MFA Rules not processed for user `f70cf334f4ea4c97be52af0e5047bb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 11:12:02.889634 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:12:02.896654 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1485/2933] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 5 11:12:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 11:12:09.240670 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=37 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:12:12.883362 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=3 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:13:53.693072 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:13:53.712391 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e82ed-6435-4a4e-8e40-b1eb9f51d417 service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:13:53.716065 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:13:53.716693 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:13:53.716974 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:13:53.717246 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:13:53.726801 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:13:53.728224 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:13:53.737179 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1449/2934] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:13:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:14:03.733051 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=10 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:14:08.474730 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:08.485307 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18607200-f371-4d7a-ba3d-266d6d9c80eb None None] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:08.488910 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80d508c497124391ad6e0ff77a534b0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:08.489511 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:08.489783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:08.490046 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:08.564622 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:08.566012 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:08.585185 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1486/2935] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:14:12.176495 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:12.198256 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5a0b-1f25-4130-bba4-264e213aad32 service neutron] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:12.205960 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:12.206751 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] REQUEST_METHOD: `GET` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:12.207331 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:12.207878 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:12.211441 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:14:12.229159 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:12.230882 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:12.242700 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1450/2936] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:14:16.175175 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:16.185399 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcd34d-46e8-4953-842d-06d673975e24 service neutron] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:16.191005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:16.191926 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:16.192301 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:16.192708 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] PATH_INFO: `/v3/users/f70cf334f4ea4c97be52af0e5047bb0b` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:16.194246 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70cf334f4ea4c97be52af0e5047bb0b)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:16.196231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:16.416261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70cf334f4ea4c97be52af0e5047bb0b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:16.421292 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70cf334f4ea4c97be52af0e5047bb0b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:16.424760 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70cf334f4ea4c97be52af0e5047bb0b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:16.438365 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70cf334f4ea4c97be52af0e5047bb0b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:16.439231 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70cf334f4ea4c97be52af0e5047bb0b'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:16.563205 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1487/2937] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:14:16 2022] DELETE /identity/v3/users/f70cf334f4ea4c97be52af0e5047bb0b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:14:16.821830 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:16.831657 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6edc-7f28-435f-849a-36e87b03e9d4 service placement] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:16.889091 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:16.889764 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:16.890049 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:16.890366 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] PATH_INFO: `/v3/projects/c5366550c35e45c48938b8afcabef8cd` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:16.891446 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5366550c35e45c48938b8afcabef8cd)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:16.893389 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:17.008865 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5366550c35e45c48938b8afcabef8cd', 'request_id': 'req-a5728a2f-a726-4bd0-8db5-53e482ffd61c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.014947 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5366550c35e45c48938b8afcabef8cd', 'request_id': 'req-a5728a2f-a726-4bd0-8db5-53e482ffd61c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.082231 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5366550c35e45c48938b8afcabef8cd', 'request_id': 'req-a5728a2f-a726-4bd0-8db5-53e482ffd61c'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.106145 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] The token cache is being invalidate because project c5366550c35e45c48938b8afcabef8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:14:17.106548 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.107048 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.109097 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1451/2938] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:14:16 2022] DELETE /identity/v3/projects/c5366550c35e45c48938b8afcabef8cd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:14:17.113602 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:17.115184 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:14:17.131920 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3fb1-abb5-4342-9816-7d53e9b9346d admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:17.176477 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:14:17.188479 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:17.189381 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:17.189783 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:17.190061 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] PATH_INFO: `/v3/users/614a5a8d5ed64af086dc2b87a73c4676` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:17.191250 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614a5a8d5ed64af086dc2b87a73c4676)` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:17.193866 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:17.415519 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614a5a8d5ed64af086dc2b87a73c4676'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.416180 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614a5a8d5ed64af086dc2b87a73c4676'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.424418 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614a5a8d5ed64af086dc2b87a73c4676'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.436005 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614a5a8d5ed64af086dc2b87a73c4676'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.436722 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.notifications [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614a5a8d5ed64af086dc2b87a73c4676'} {{(pid=93531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.527903 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1488/2939] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 5 11:14:17 2022] DELETE /identity/v3/users/614a5a8d5ed64af086dc2b87a73c4676 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:14:17.782501 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Authenticating user token {{(pid=93530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:14:17.783977 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.fernet_utils [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:14:17.800922 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5728a2f-a726-4bd0-8db5-53e482ffd61c admin admin] Validating token access rules against request {{(pid=93530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:14:17.861970 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcff4f18a9994f58badcd6e80f8b0bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e124170ce0a463092ee8c909184559a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:14:17.862631 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:14:17.862869 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:14:17.863136 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] PATH_INFO: `/v3/projects/5090fa311c864e1fbb808773b68a1e96` {{(pid=93530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:14:17.864303 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5090fa311c864e1fbb808773b68a1e96)` {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:14:17.866247 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] RBAC: Authorization granted {{(pid=93530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:14:17.874194 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:14:17.986573 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5090fa311c864e1fbb808773b68a1e96', 'request_id': 'req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:17.991899 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5090fa311c864e1fbb808773b68a1e96', 'request_id': 'req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:18.087893 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5090fa311c864e1fbb808773b68a1e96', 'request_id': 'req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d'} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:18.099895 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] The token cache is being invalidate because project 5090fa311c864e1fbb808773b68a1e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 11:14:18.100190 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:18.100852 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG keystone.notifications [None req-d2f2554e-857f-4f3c-87d4-991a3d4f3d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 11:14:18.102346 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: [pid: 93530|app: 0|req: 1452/2940] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 5 11:14:17 2022] DELETE /identity/v3/projects/5090fa311c864e1fbb808773b68a1e96 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 11:14:27.524263 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:14:28.096921 dv-cinder-850831-4-iscsi devstack@keystone.service[93530]: DEBUG dbcounter [-] [93530] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 11:17:04.998710 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Authenticating user token {{(pid=93531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 11:17:05.000137 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:17:05.068999 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cda62-94e8-4d08-9780-353d6ca7c217 admin admin] Validating token access rules against request {{(pid=93531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 11:17:05.126984 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3358589f4e9649beb8bffdf51844b59c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0fc34e3070b4d1790aca33e287c8742', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 11:17:05.127591 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] REQUEST_METHOD: `GET` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 11:17:05.127880 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] SCRIPT_NAME: `/identity` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 11:17:05.128154 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 11:17:05.129914 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.fernet_utils [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 11:17:05.141261 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 11:17:05.142850 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac01ba9-694c-4289-bbf5-5fcd59e2b993 service placement] RBAC: Authorization granted {{(pid=93531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 11:17:05.153849 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: [pid: 93531|app: 0|req: 1489/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 5 11:17:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 11:17:15.149133 dv-cinder-850831-4-iscsi devstack@keystone.service[93531]: DEBUG dbcounter [-] [93531] Writing DB stats keystone:SELECT=58 {{(pid=93531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}